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PREFACE 


The  purpose  of  this  survey  was  to  assist  the  Current  News  Analysis  and  Research 
Service  (CNARS)  in  ensuring  that  the  information  needs  of  its  DoD  audience  are  being  met 
by  Current  News  Early  Bird  and  its  Supplement.  A  25  percent  response  rate  supported  the 
conclusion  that  both  Early  Bird  and  the  Supplement  are  read  and  judged  to  be  highly 
effective  by  a  large  segment  of  military  and  civilian  managers  in  DoD.  Results  also  indicate 
that  a  large  proportion  of  readers  receive  their  copies  outside  the  distribution  channels  used 
by  CNARS.  The  actual  number  of  readers  is  estimated  at  greater  than  15,000. 

Every  survey  has  its  challenges,  but  this  one  was  especially  intriguing.  The 
difficult  part  was  to  sample  a  population  about  which  we  knew  nothing  without  using  the 
publication  itself  as  a  vehicle  for  the  questionnaire.  The  insight  came  with  a  reference  to  the 
science  of  epidemiology.  Once  we  began  to  conceive  of  the  distribution  of  the  publication 
as  a  "vector"  it  was  merely  a  matter  of  analyzing  the  CNARS  distribution  modes  and  then 
following  them  with  our  questionnaire.  The  "O-DARK-30"  exit  interviews  conducted  with 
literally  hundreds  of  couriers  at  the  CNARS  distribution  desk  will  be  fondly  remembered 
by  the  research  team. 
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ABSTRACT 


The  purpose  of  this  study  was  to  assist  the  Current  News  Analysis  and  Research 
Service  (CNARS)  in  ensuring  that  the  information  needs  of  its  DoD  audience  are  being  met 
by  two  publications,  Current  News  Early  Bird  and  its  Supplement.  In  this  IDA  effort, 
readership  surveys  were  planned,  conducted,  and  analyzed.  The  questionnaire  that  evolved 
from  this  effort  elicited  responses  concerning  distribution,  content,  and  availability  of  the 
publications  and  demographic  information  about  the  readers.  Results  show  that  both  Early 
Bird  and  Supplement  are  read  overwhelmingly  by  members  of  the  Armed  Services.  The 
vast  majority  of  respondents  provided  high  ratings  of  effectiveness  for  both,  and  most 
noted  their  ability  to  inform  readers  of  DoD  information  that  assists  them  with  their  Jobs. 
Most  respondents  held  the  officer  ranks  of  04-06,  noted  affiliation  with  the  Army  or  Air 
Force,  and  held  positions  described  as  Manager  or  Action  Officer.  Results  also  indicate 
that  a  large  proportion  of  Early  Bird  and  Supplement  readers  receive  these  publications 
through  indirect  means,  outside  the  distribution  channels  employed  by  the  CNARS  staff; 
the  actual  number  of  readers  is  nearly  twice  as  large  as  the  8,600  copies  produced  each  day. 
The  research  team  recommends  that  CNARS  continue  its  editorial  policies  unchanged  and 
that  future  assessments  of  the  impact  of  its  publications  be  conducted  on  a  regular  basis. 
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EXECUTIVE  SUMMARY 


A.  INTRODUCTION 

The  American  Forces  Information  Service  (APIS)  has  established  25  information 
objectives  in  support  of  DoD  policy.  Current  News  Early  Bird  and  the  Current  News 
Supplement  (EB/Supplement),  two  of  the  print  media  products  produced  by  CNARS, 
provide  a  means  for  achieving  those  objectives  within  the  military  and  civilian  audience. 
Specifically,  they  are  designed  to  keep  civilian  and  military  officials  abreast  of  how  DoD 
activities  are  being  reported  in  newspapers,  magazines,  newsletters,  and  other  print  media 
and  in  the  on-line  electronic  news  sources  such  as  Desktop  Data,  Reuters  transcript  service, 
and  DataTimes.  These  publications  are  distributed  to  enhance  the  knowledge  level  and  duty 
performance  of  DoD  personnel  thereby  increasing  force  readiness.  The  daily  18-page  EB 
and  the  more  detailed  Supplement  (which  averages  77  pages  daily)  are  aimed  at  a  DoD- 
wide  audience  defined  as  high-level  military  and  civilian  personnel  supporting  DoD 
activities.  The  daily  production  run  consists  of  8,600  copies  of  EB  and  650  copies  of 
Supplement. 

B .  PURPOSE  AND  OBJECTIVES  OF  THE  STUDY 

The  purpose  of  this  study  was  to  assist  the  Current  News  Analysis  and  Research 
Service  (CNARS)  in  ensuring  that  the  information  needs  of  its  Department  of  Defense 
(DoD)  audiences  are  being  met  by  EB  and  the  Supplement.  This  Institute  for  Defense 
Analyses  (IDA)  effon  was  undertaken  to  plan,  conduct,  and  analyze  a  survey  tailored  to  the 
readership  of  these  two  publications.  The  questionnaire  that  evolved  from  the  goals  of  this 
effort  elicited  responses  concerning  the  distribution,  content,  and  availability  of  the  two 
publications  and  demographic  information  about  their  readers. 

C.  TECHNICAL  APPROACH 

The  traditional  first  step  in  a  survey  is  to  gather  information  on  the  size,  strata,  and 
distribution  of  the  target  population  in  preparation  for  sample  selection.  In  the  EB/ 
Supplement  case,  the  audience  was  unknown  and  the  determination  of  its  characteristics 
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was  the  major  reason  to  do  the  study.  The  method  for  accomplishing  this  was  to  analyze 
the  distribution  process  for  the  documents  and  then  follow  the  same  routes  with  the 
questionnaires.  Distribution  routes  included  courier  pick-up  directly  from  the  CNARS 
office,  U.S.  mail,  and  the  CNARS  fax  network. 

Since  one  of  the  major  goals  of  this  effort  was  to  obtain  information  about  the 
existence  of  readers  who  receive  these  publications  indirectly,  or  second-hand,  from  the 
initial  recipients,  surveys  were  sent  out  in  a  proportion  much  larger  than  the  known  number 
of  EB/Supplement  copies  produced.  Two  methods  were  used  by  the  research  team  to 
capture  information  about  this  "shadow"  audience;  (1)  a  ratio  of  5  surveys  to  1  issue  was 
employed,  and  (2)  questions  were  included  within  the  survey  asking  indirect  recipients  to 
indicate  the  method  through  which  they  receive  the  publication. 

The  next  step  was  to  determine  whether  or  not  the  periodical  met  the  needs  of  the 
audience  with  regard  to  content  and  format  of  information,  editorial  procedures,  and 
distribution  methods,  frequency,  and  timeliness  of  the  articles.  Therefore  we  transformed 
these  effectiveness  measures  into  assessment  dimensions  relative  to  the  audience 
requirements  identified  above.  The  measures  were  then  used  to  derive  survey  items  and 
measurement  scales  which  could  be  grouped  into  sections  for  ease  of  administration  and 
scoring,  and  integrated  into  a  prototype  survey  instrument. 

After  the  prototype  was  edited  for  content,  syntax,  and  spelling,  it  was  pretested  for 
"user  friendliness"  by  a  small  group  of  IDA  personnel  representative  of  the  intended 
audience.  The  test  was  conducted  to  assess  readability,  comprehension,  ease  of 
administration,  clarity  of  instructions,  and  scoring  procedures.  Lessons  learned  were 
integrated  into  the  second  draft  which  was  distributed  to  the  target  audience  via  "saturation" 
sampling  in  the  three  distribudon  modes. 

Responses  were  keyed  into  a  relational  data  base  and  then  verified  for  accuracy  as 
they  were  received  resulting  in  the  means  and  standard  deviations  included  in  summary 
tables  in  this  report. 

D.  CONCLUSIONS  FROM  THE  SURVEY  RESULTS 
1 .  Current  News  Early  Bird 

Of  approximately  20,000  questionnaires  sent  out,  3,800  responses  were  received 
yielding  a  raw  response  rate  of  19  percent.  Using  this  sample  of  3,800,  we  tabulated  the 
responses  to  questions  dealing  with  disposition  of  the  EB  after  the  respondent  finished 
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with  it.  These  results  allowed  a  conservative  estimate  of  total  audience  size  (direct  and 
indirect  recipients)  of  15,213  readers  or  about  two  readers  per  copy  of  EB.  The  response 
rate  calculated  from  this  conservative  estimate  of  audience  size  was  25  percent.  Therefore 
the  true  response  rate  lies  between  19  and  25  percent. 

In  terms  of  content,  the  vast  majority  of  respondents  provided  verv  positive  ratings 
for  EB's  effectiveness.  The  specific  topics  of  most  interest  included  DoD  Organization  and 
Budget  and  International  Security  Issues.  Most  respondents  indicated  that  EB  helps  them 
perform  their  jobs  by  providing  valuable  information  regarding  DoD  policies,  procedures, 
and  activities. 

2.  Supplement 

Of  the  3,800  completed  surveys  returned,  1,967  indicated  that  the  respondents  also 
read  the  Supplement.  Since  this  number  of  readers  is  three  times  larger  than  the  daily 
production  run  of  650,  we  can  infer  that  the  Supplement  also  has  a  large  shadow  audience, 
although  we  could  not  calculate  its  size  in  this  study. 

The  majority  of  Supplement  readers  in  this  sample  provided  very  favorable  ratings 
for  Supplement  as  an  effective  publication,  and  indicated  that  they  read  half  or  more  of  the 
periodical  regularly.  Many  indicated  that  Supplement  provides  them  with  information  that 
helps  them  perform  their  jobs  and  informs  them  of  the  effect  of  DoD  policy  decisions  on 
public  opinion. 

E.  RECOMMENDATIONS 

The  results  of  this  survey  strongly  suggest  that  CNARS  is  doing  a  great  service  for 
its  readers  and  that  the  audience  is  far  larger  than  suspected.  Therefore  policies  and 
procedures  pertaining  to  publication,  editorial  activities,  and  distribution  of  EB  and  the 
Supplement  should  continue  unchanged.  It  is  recommended  that  the  readership  be 
surveyed  on  a  regular  basis  using  the  same  survey  instrument,  or  at  least  a  representative 
set  of  the  original  survey  items,  in  order  to  maintain  reliability  and  allow  for  trend  analysis. 
Any  changes  in  CNARS  policy  should  await  the  results  of  the  next  survey  effort. 

However,  future  survey  efforts  involving  this  population  should  explore  alternate 
methods  to  reach  indirect  recipients.  Multiple,  tear-out  questionnaires  bound  into  the 
publications  themselves,  as  well  as  distribution  through  other  channels  such  as  interoffice 
mail,  have  been  suggested.  Questions  addressed  to  Supplement  readers  regarding  the 
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method  of  publication  receipt  and  disposition  are  also  recommended  in  order  to  provide  a 
more  rigorous  estimate  of  the  total  size  of  this  readership.  In  terms  of  content,  it  is 
suggested  that  CNARS  continue  to  provide  articles  in  the  topic  areas  of  DoD  Organization 
and  Budget  and  International  Security  Issues,  as  these  were  rated  the  most  valuable  by  this 
sample  of  respondents. 


I.  INTRODUCTION 


A.  BACKGROUND 

Current  News  Early  Bird  (EB)  and  the  Current  News  Supplement  (Supplement)  are 
DoD-oriented  publications  of  the  American  Forces  Information  Service  (APIS),  edited  and 
produced  by  the  Current  News  Analysis  and  Research  Service  (CNARS).  The  mission  of 
APIS  is  to  communicate  internal  information  about  DoD  policies  and  programs  to  the 
military  and  civilian  audience  worldwide  through  print  and  broadcast  media. 

EB  and  Supplement  are  two  of  the  print  media  products  produced  by  CNARS  to 
implement  APIS  information  objectives  in  support  of  DoD  policy,  within  the  military  and 
civilian  audience.  These  two  daily  publications  are  intended  to  keep  civilian  and  military 
officials  abreast  of  how  DoD  activities  are  being  reported  in  newspapers,  magazines, 
newsletters,  and  other  print  media  and  in  the  on-line  electronic  news  sources  such  as 
Desktop  Data,  Reuters  transcript  service,  and  DataTimes.  The  daily  18-page  EB  and  its 
more  detailed  Supplement  (which  averages  77  pages  daily)  are  two  key  products  designed 
for  their  DoD-wide  audience.  The  daily  production  run  consists  of  8,600  copies  of  EB  and 
650  copies  of  Supplement  The  target  audience  for  these  two  publications  has  been  defined 
as  high-level  military  and  civilian  personnel  supporting  DoD  activities.  These  publications 
enhance  the  knowledge  level  and  duty  performance  of  DoD  personnel,  thereby  increasing 
force  readiness. 

B .  PURPOSE  AND  OBJECTIVES 

The  purpose  of  this  effort  is  to  determine  whether  two  specific  CNARS  periodicals, 
EB  and  Supplement,  are  meeting  the  information  needs  of  the  DoD  audience.  Therefore, 
IDA  conducted  the  EB/Supplement  Readership  Survey  to  provide  the  CNARS  management 
with  current  demographic  information  about  their  target  audience,  estimate  the  size  of  the 
"shadow"  audience  previously  unknown,  and  measure  the  perceived  effectiveness  of  the 
publications. 

To  accomplish  this  assessment,  we  must  first  define  "information  needs"  and 
"audience,"  then  we  must  develop  a  set  of  measures  of  effectiveness,  and,  finally,  produce 


a  system  for  collecting  audience  responses,  analyzing  the  data,  and  reponing  the  results. 
These  objectives  are  delineated  in  terms  of  the  worksteps  presented  below. 

C.  TECHNICAL  APPROACH 

The  technical  approach  taken  to  conducting  the  survey  was  divided  into  five  phases, 
with  each  phase  broken  down  into  the  steps  necessary  to  implement  its  objective.  The 
survey  distribution  technique  is  explained  in  detail  in  Chapter  n. 

1 .  Analyze  Target  Population 

In  most  cases  the  size,  strata,  and  distribution  of  the  target  population  are 
determined  in  preparation  for  sample  selection.  In  the  EB/Supplement  case,  the  audience 
characteristics  were  unknown  and,  in  fact,  were  the  major  reason  to  do  the  study. 

2 .  Identify  Audience  Information  Needs 

To  determine  whether  or  not  the  periodical  is  meeting  the  needs  of  the  audience,  we 
first  identified  the  needs  of  the  audience  with  regard  to  content  and  format  of  information, 
editorial  procedures,  and  distribution  methods,  frequency,  and  latency.  In  the  case  of  EB 
the  requirements  were  straightforward.  The  audience  needs  a  sample  of  news  articles  about 
DoD  topics.  What  isn’t  obvious  is  why  they  need  it.  If  we  know  what  use  they  have  for 
the  information,  we  may  know  better  what  to  include  in  the  EB  topic  menu  and  how  to 
present  it  more  effectively.  This  was  discovered  by  a  series  of  interviews  with  CNARS 
staff  and  selected  EB  readers,  in  which  we  established  the  dimensions  on  which  the 
audience  "unconsciously"  evaluates  these  periodicals. 

3 .  Develop  Effectiveness  Measures 

Three  major  evaluation  dimensions  are  called  out  in  the  Task  Order,  namely, 
content,  format,  and  distribution.  The  next  step  was  to  develop  these  effectiveness 
measurement  concepts  into  assessment  dimensions  relative  to  the  audience  requirements 
identified  above.  The  study  team  analyzed  each  of  the  three  dimensions  to  identify 
component  measures  which  tap  more  sophisticated  audience  needs--for  example, 
assessments  of  comprehensiveness,  penetration  depth,  and  indicators  of  inadvertent 
political  or  regional  bias  in  the  articles  selected. 


4 .  Develop  Survey  Instrument 

The  measures  of  effectiveness  for  content,  format,  and  distribution  formed  the  basis 
for  translating  measures  into  survey  items  and  scales  and  combining  them  into  a  prototype 
survey  instrument  for  pretest.  Such  an  information  item  might  read,  "Using  the  scale 
below,  select  the  best  response  for  each  of  the  statements  (a-e)  and  write  its  number  in  the 
appropriate  box."  Following  this  item  is  a  scale  on  which  1  indicates  strong  agreement, 
and  5  means  strong  disagreement.  Items  like  this  one  were  used  to  elicit  data  on  the  scope 
of  EB  coverage,  duty  relevance,  and  general  value  of  the  publication.  After  all  the  items 
were  designed,  they  were  grouped  into  sections  for  ease  of  administration  and  scoring  and 
integrated  into  a  prototype  survey  instrument. 

After  the  prototype  was  edited  for  content,  syntax,  and  spelling,  it  was  tested  for 
"user  friendliness"  by  a  small  group  of  IDA  personnel  representative  of  the  target  audience. 
The  test  was  conducted  to  assess  readability,  comprehension,  administrative  ease,  clarity  of 
instructions,  and  scoring  procedures.  Lessons  learned  were  integrated  into  the  second 
draft.  The  finished  questionnaire  is  included  as  Appendix  A. 

Concurrent  with  the  development  of  the  second  draft,  IDA  began  the  process  of 
obtaining  permission  from  Washington  Headquaners  Services/Directorate  for  Information, 
Operations,  and  Reports  (WHS/DIOR)  to  distribute  the  survey.  IDA  implemented  a 
request  for  approval  of  information  collection  through  the  Office  of  the  Assistant  Secretary 
of  Defense  (Public  Affairs)  [OASD(PA)]  including  the  necessary  justification  and  cost 
worksheet  (Form  101)  and  was  granted  repon  control  symbol  DD-PA  (OT)  1853  February 
1991  in  accordance  with  OASD(PA)  regulations. 

5 .  Collect  and  Reduce  Data 

Once  received,  the  responses  were  keyed  and  verified  for  data  reduction  and  filing. 
The  returns  were  processed  as  they  were  received  and  a  relational  data  base  was  developed. 
The  data  base  is  flexible  and  extensive  enough  to  handle  the  volume  and  diversity  of 
responses  and  any  specialized  analyses  that  may  be  required.  The  data  were  first  reduced 
and  characterized  by  means  and  standard  deviations  for  inclusion  in  summary  tables  in  this 
repon.  If  further  analyses  are  required  in  the  future,  they  can  easily  be  supported  with  the 
current  data  base.  In  the  next  chapter  we  discuss  the  actual  process  of  survey  distribution 
which  in  this  case  is  more  complex  than  usual. 


II.  METHODOLOGY  FOR  EARLY  BIRD/SUPPLEMENT 
QUESTIONNAIRE  DISTRIBUTION 


The  following  discussion  details  the  methodology  used  for  distributing  the 
EB/Supplement  Readership  Questionnaire,  including  sampling  strategy,  mode  of 
distribution,  and  length  of  data  collection  period.  Since  the  target  audience  of  EB  is 
considerably  larger  than  that  of  Supplement,  and  the  Supplement  readers  are  believed  to 
receive  EB  as  well,  a  single  distribution  plan  was  developed  to  elicit  responses  from  both 
audiences.  The  distribution  plan  is  divided  into  four  major  aspects:  Distribution  and 
Sampling  Strategy;  Preparation  and  Clarification;  Notification  of  Survey  Effon;  and 
Collection  of  Completed  Surveys.  Each  of  these  aspects  is  detailed  in  the  following 
discussions. 

A.  DISTRIBUTION  AND  SAMPLING  STRATEGY 

Since  EB/Supplement  is  distributed  via  three  distinct  modes  (i.e.,  courier/CNARS 
pick-up,  CNARS  fax  network,  and  direct  mail),  distribution  of  the  survey  also  required 
multiple  distribution  methods  to  maximize  audience  representation. 

1 .  Sampling  Plan 

The  use  of  all  three  survey  distribution  channels  allowed  the  research  team  the 
ability  to  access  the  formal  population  of  8,600  EB/Supplement  recipients.  This  initial 
estimate  of  the  EB/Supplement  audience  is  simply  based  on  the  number  of  publications 
prepared  each  day.  The  pivotal  issue  in  the  sampling  plan  is  the  perception  that  the 
number  of  publications  is  a  significant  underestimate  of  the  actual  audience  who  read 
EB/Supplement  It  was  hypothesized  before  the  survey  that  the  "shadow"  audience  is 
much  greater  than  the  number  distributed  and  that  this  shadow  audience  would  bias  the 
results  if  we  did  not  include  them  in  the  sample. 

Developing  a  methodology  for  surveying  the  "shadow"  audience  proved  very 
challenging,  since  no  information  regarding  the  size  or  characteristics  of  this  group  existed 
beyond  the  speculation  of  the  CNARS  staff.  Two  steps  were  implemented  to  verify  the 
existence  of  this  group  and  obtain  demographic  information  about  them.  The  first  approach 


was  to  implant  items  in  the  questionnaire  designed  to  elicit  information  about 
EB/Supplement  readers  who  may  receive  the  publication  indirectly,  i.e.,  by  means  other 
than  the  three  distribution  channels  used  by  CNARS.  The  second  approach  was  to  produce 
and  distribute  the  surveys  in  a  much  larger  proportion  than  the  number  of  original  issues 
circulated  each  day.  Those  who  receive  EB/Supplement  directly  were  requested  to  pass  the 
publication  and  questionnaire  along  to  the  indirect  recipient. 

A  ratio  of  five  survey  questionnaires  for  each  copy  of  EB/Supplement  was  sent  to 
the  target  audience.  This  ratio  was  deemed  optimal,  as  it  allowed  for  more  than  one  reader 
per  issue  to  complete  a  survey,  and  was  not  excessive  in  terms  of  cost  or  ability  to 
implement.  Distributing  fewer  surveys  would  sample  the  shadow  audience  insufficiently, 
while  a  larger  ratio  of  surveys  would  have  been  too  cumbersome  in  terms  of  circulation. 

2 .  Distribution  Modes  and  Schedule 

As  we  stated  before,  EB  and  Supplement  are  distributed  to  their  recipients  in  three 
ways.  Some  get  their  copies  by  courier  or  by  picking  them  up  directly  from  the  CNARS 
desk,  some  get  them  in  the  U.S.  mail,  and  some  receive  their  copies  over  the  CNARS  fax 
network.  In  order  to  determine  where  to  send  the  packages  of  surveys,  the  couriers/readers 
who  pick  up  the  publications  directly  from  the  CNARS  office  were  interviewed  as  they 
waited  in  line  over  three  consecutive  mornings.  They  were  asked  their  names,  the  number 
of  copies  they  pick  up,  their  telephone  numbers,  and  their  office  numbers  and  symbols. 
The  IDA  team  then  prepared  and  distributed  bundles  of  surveys  with  an  accompanying 
handbill  of  instructions  for  the  point  of  contact  to  deliver  the  surveys  to  the  direct 
EB/Supplement  recipients. 

Those  who  receive  EB/Supplement  via  direct  mail  or  fax  had  surveys  mailed 
directly  to  their  work  address.  (The  mailing  address  of  fax  locations  was  requested 
2  weeks  prior  to  planned  distribution-see  Section  B.) 

The  distribution  schedule  for  implementing  the  survey  began  March  4,  1991,  and 
continued  through  March  15,  1991.  This  time  period  was  chosen  based  on  the  physical 
limitations  of  distributing  to  all  8,600  original  recipients  within  1  day  using  the  different 
methods.  The  IDA  team  concluded  that  completing  distribution  within  1  day  would  be 
critical  only  if  the  survey  were  evaluating  a  specific  issue.  Since  the  main  concern  of  this 
effon  is  the  evaluation  of  EB/Supplemcnt  in  general,  the  extended  distribution  period 
proved  adequate. 


3 .  Levels  of  Distribution 

Three  levels  of  distribution  were  also  identified  within  each  distribution  mode  (i.e., 
direct  mail,  pick-up,  or  fax).  These  levels  include  the  DoD  offices  which  receive  copies  of 
the  publications  directly  from  the  CNARS  office,  the  points  of  contact  within  these  offices 
who  distribute  each  edition  within  an  office,  and  the  individual  reader.  The  typical 
distribution  pattern  of  EB/Supplement  using  the  courier/CNARS  pick-up  mode  follows  the 
sequence  of  office  delivery  to  point  of  contact,  then  distribution  within  an  office  to 
individual  readers. 

Fax  recipients  serve  as  both  the  initial  office  delivery  and  point  of  contact. 
Individuals  who  receive  the  original  CNARS  transmission  distribute  the  publications 
among  readers  at  their  specific  locations. 

Direct-mail  recipients  carry  out  the  distribution  pattern  among  the  levels  in  reverse 
order.  They  are  considered  initial  readers  who  may  also  be  points  of  contact,  distributing 
their  EB/Supplement  copy  among  co-workers. 

B .  PREPARATION  AND  CLARIFICATION 

Preparation  of  the  survey  instrument  was  conducted  by  the  IDA  team,  which 
included  acquiring  mailing  labels  from  CNARS  for  direct-mail  EB/Supplement  recipients, 
obtaining  fax  numbers  and  names  of  initial  recipients  at  those  destinations  receiving 
EB/Supplement  by  fax,  and  drafting  all  instructions  for  inclusion  within  the  survey  and 
within  EB  itself.  Separate  letters  of  introduction/instruction  to  points  of  contact,  fax 
recipients,  and  direct-mail  recipients  were  also  prepared  during  this  phase.  Evaluation  of 
the  survey  for  coherence  and  clarity  of  questions  and  instruction  was  conducted  by  IDA 
representatives.  A  sample  of  12  individuals  unfamiliar  with  the  survey  evaluated  the 
instrument  for  clarity  of  wording,  sufficient  representation  and  coherence  of  response 
alternatives,  survey  format,  and  time/difficulty  to  complete.  Recommendations  resulting 
from  this  pretest  were  incoiporated  into  the  survey  draft  before  printing  the  final  version. 

C .  ALERTING  THE  AUDIENCE  TO  SURVEY  EFFORT 

The  survey  audience  was  alened  several  times  in  advance  of  actual  survey 
implementation  to  call  attention  to  the  importance  of  the  effon  and  maximize  the  ultimate 
participation  level.  Notification  of  the  upcoming  survey  was  communicated  through  the 
three  distribution  channels,  as  well  as  posted  within  EB/Supplement  itself. 


The  use  of  pre-survey  announcements  was  determined  to  be  the  most  effective 
means  of  alerting  readers  to  the  survey  effort,  as  the  anonymity  of  the  audience  prevented 
direct  mailing  of  personal  pre-  or  post-survey  correspondence  requesting  participation. 
Pre-implementation  announcements  were  also  selected  as  a  means  to  introduce  readers  to 
the  goals  of  the  effort,  instilling  a  personal  interest  to  participate,  and  enhancing  reader 
motivation.  Follow-up  messages  communicated  after  the  distribution  period  were  not 
implemented,  as  participants  were  deemed  more  likely  to  ask  for  a  survey  when  aware  of 
its  impending  distribution,  rather  than  request  a  copy  after  the  fact.  In  an  attempt  to  ensure 
maximum  exposure  to  the  readership  audience,  notification  was  conducted  several  times 
before  implementation  of  the  survey,  as  detailed  below. 

1 .  Two  Weeks  Prior 

Initial  notification  of  the  forthcoming  survey  began  2  weeks  before  the  distribution 
target  date  (i.e.,  week  of  February  18-22).  Notification  was  conducted  through  all  three 
distribution  channels,  as  well  as  EB/Supplement  itself.  Announcements  consisted  of  a 
general  notice  on  the  front  page  of  EB/Supplement  addressed  to  all  readers.  The 
announcement  was  signed  by  a  DoD  official  to  enhance  credibility  and  emphasize  the 
importance  of  the  effort. 

The  CNARS  couriers  were  notified  by  posting  a  sign  at  the  CNARS  office  giving 
the  planned  distribution  target  dates  and  encouraging  participation  in  the  effort. 

Readers  receiving  EB/Supplement  via  fax  were  notified  of  the  survey  by  a  cover 
page  of  instructions  with  their  daily  copy  of  EB/Supplement.  These  recipients  were 
requested  to  fax  information  to  CNARS  including  the  name  of  the  original  fax  recipient,  the 
mailing  address  of  their  destination,  and  the  number  of  EB/Supplement  readers  at  their 
location.  Announcement  of  the  survey  also  involved  sending  individual  letters  addressed  to 
direct  mail  EB/Supplement  recipients,  again  encouraging  their  panicipation  in  the 
forthcoming  effort. 

2 .  One  Week  Prior 

One  week  before  initial  distribution,  notification  was  again  included  within  issues 
of  EB/Supplement.  A  brief  reminder  was  included  three  times  during  that  publication  week 
(i.e.,  Monday,  Wednesday,  and  Friday). 
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3 .  During  Distribution  Period 

During  the  distribution  period  a  subsequent  reminder  was  included  within  the 
publication.  Readers  were  encouraged  to  look  for  and  complete  a  copy  of  the  survey. 
Handbill-type  notices  were  attached  to  each  bundle  of  surveys  distributed,  providing 
additional  instructions  to  the  points  of  contact  who  deliver  copies  of  EB/Supplement 
within  their  offices,  and  to  direct-mail  recipients  to  pass  out  copies  of  the  survey  to  those 
who  share  their  copy  of  EB/Supplement.  Distribution  covered  approximately  2  weeks 
(March  4-15)  and  reminder  notices  were  included  in  EB/Supplement  during  this  time 
period.  All  notices  and  posters  are  included  in  Appendix  B. 

D .  COLLECTION  OF  COMPLETED  SURVEYS 

The  IDA  team  requested  respondents  to  complete  the  one-page,  multiple  choice 
survey  and  return  it,  postage  paid,  within  5  days  of  receipt.  The  collection  period  began 
March  11,  1991,  and  continued  through  May  10,  1991.  This  extended  collection  period 
was  deemed  necessary,  despite  the  request  to  return  responses  within  5  days,  as  the  rate  of 
returns  remained  fairly  constant  for  several  weeks.  An  earlier  cut-off  date  would  have 
eliminated  several  valid  surveys  from  the  data  base.  A  total  of  3,800  completed  surveys 
were  received,  key  punched,  verified,  and  entered  into  the  data  base. 
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III.  RESULTS  OF  EARLY  BIRD  SURVEY 


The  following  discussion  presents  the  results  obtained  following  analysis  of  the 
completed  EB  surveys.  This  section  is  organized  by  three  major  themes;  Demographics, 
Distribution,  including  Estimated  Audience  Size  and  Return  Rate,  and  Responses  to 
Content  Items. 

A.  DEMOGRAPHICS 

The  demographics  section  of  the  questionnaire  was  designed  to  characterize  the 
EB  audience.  The  survey  items  requesting  the  employer,  or  organizational  affiliation 
(Question  2),  the  job  type  held  (Question  4),  and  the  rank/grade  or  equivalent  non- 
Govemment  position  level  held  (Question  5)  served  as  the  basis  for  describing  this  sample 
of  EB  readers;  the  results  are  contained  in  Tables  III-l  to  III-3  in  this  chapter.  In  these  and 
the  following  tables,  any  difference  from  a  total  of  100%  in  the  "Percent"  column  is  due  to 
rounding  beyond  the  decimal  point.  Frequencies  of  responses  to  the  organizational  mission 
question  (Question  3)  and  the  education  question  (Question  6)  are  presented  as  tables  in 
Appendix  C. 

A  total  of  3,8(X)  completed  surveys  were  received.  Of  those,  the  largest  proponion 
reponed  affiliation  with  the  Air  Force  (28.2%  of  all  respondents  to  this  item,  n  =  1,071)  or 
the  Army  (27.2%,  n  =  1,034).  See  Table  III-l  for  the  frequency  distribution  of  all 
responses  to  the  affiliation  item.  The  fact  that  the  Air  Force  had  the  highest  number  of 
respondents  may  be  an  artifact  created  by  CNARS’  previous  affiliation  with  the  Air  Force. 
While  this  may  be  an  explanation  for  the  preponderance  of  Air  Force  readers,  it  is  not  a 
justification.  Therefore,  in  future  surveys  the  research  team  must  be  careful  to  take  this 
bias  into  account  when  designing  the  survey  distribution  scheme. 

Most  respondents  held  jobs  which  they  described  as  Manager  (30.4%,  n  =  1,155) 
or  Action  Officer  (29.6%,  n  =  1,124).  Table  III-2  presents  the  frequency  distribution  for 
all  responses  to  the  survey  question  pertaining  to  the  respondent's  job.  The  most 
frequently  reponed  ranks/grades  were  officers  in  the  ranks  of  04-06  (45.5%,  n  =  1,730) 
and  government  employees  in  the  grades  of  GS/GM13-GS/GM15  (16.9%,  n  =  641). 


Table  III-1.  Frequency  of  Responses  to  Question  2: 
"I  work  for:”  (Employer) 

All  Respondents 


Employer 

Frequency 

Percent 

Cumulative 

Percent 

Army 

1034 

27.2% 

27.3% 

Navy 

456 

12% 

39.4% 

Air  Force 

1071 

28.2% 

67.7% 

Marines 

40 

1.1% 

68.8% 

Coast  Guard 

27 

.7% 

69.5% 

DoO  Staff/Agency 

510 

13.4% 

83% 

Academic 

Community 

57 

1.5% 

84.5% 

Congress 

118 

3.1% 

87.6% 

Congressional 

Support 

21 

.6% 

88.2% 

Non-Academic 

Research 

92 

2.4% 

90.6% 

Other 

356 

9.4% 

100% 

No  response  to 
this  item 

18 

.5% 

not  included 

Column  Total  & 
Percent 

3800 

100% 

100% 

I 
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Table  III-2.  Frequency  of  Responses  to  Question  4: 
"My  job  can  be  best  described  as:"  (Job) 

All  Respondents 


Job 

Frequency 

Percent 

Cumulative 

Percent 

Policy  Maker 

357 

9.4% 

9.5% 

Manager 

1155 

30.4% 

40.1% 

Action  Officer 

1124 

29.6% 

69.9% 

Scholar/Analyst 

398 

10.5% 

80.5% 

Clerical/Admini¬ 

strative 

321 

8.4% 

89% 

Technical 

155 

4.1% 

93.1% 

Non-Government 

Management 

19 

.5% 

93.6% 

Other 

242 

6.4% 

100% 

No  response  to 
this  item 

29 

.8% 

not  included 

Column  Total  & 
Percent 

3800 

100% 

100% 
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Table  111-3  provides  the  frequency  of  all  responses  to  the  rank/grade  item.  Based  on  these 
results  it  is  apparent  that  the  sample  is  reflective  of  the  stated  target  audience  for  the 
publication  based  on  interviews  with  CNARS  staff  prior  to  distribution. 

B.  DISTRIBUTION,  ESTIMATED  AUDIENCE  SIZE,  AND 
RESPONSE  RATE 

A  primary  purpose  of  this  effort  was  to  estimate  the  total  size  of  EB's  readership. 
Although  8,600  EBs  are  produced  daily,  the  CNARS  staff  believed  that  a  much  greater 
number  of  actual  readers  existed.  This  so-called  "shadow  audience"  was  believed  to 
receive  EB  second-hand  from  an  original  recipient  or  receive  a  reproduction  of  an  original 
copy,  but  no  empirical  investigation  into  the  actual  existence  of  this  shadow  audience  or 
any  estimation  of  its  size  had  ever  been  attempted. 

Gathering  data  on  the  existence  and  size  of  a  shadow  audience  is  at  best 
problematic.  The  difficulty  is  simple:  the  investigator  lacks  even  the  rudimentary 
information  about  the  audience  which  is  required  to  conduct  a  survey.  At  the  outset,  we 
had  no  idea  who  the  shadow  audience  members  were,  where  they  resided,  or  what  their 
demographic  characteristics  were.  In  order  to  collect  such  data,  a  number  of  questions 
were  included  in  the  survey  instrument  specifically  addressing  those  who  are  not  the  first 
recipient  of  an  original  EB  or  are  recipients  of  photocopies  and  allowing  them  to  provide 
information  about  their  mode  of  receipt.  The  following  questions  were  designed  to 
investigate  these  issues: 

•  Question  9  ("The  color  of  the  front  page  of  the  EB  I  receive  is  usually:") 

•  C^estion  10  ("I  usually  receive  EB  from:") 

•  Question  12  ("When  I  finish  with  EB,  I  usually:") 

•  (Question  13  ("When  I  pass  it  on,  I:"). 

These  questions  provided  information  regarding  the  proportion  of  respondents  who 
receive  a  reproduction  of  EB,  where/who  they  receive  EB  from,  what  they  do  with  EB  after 
reading  it,  and  how  they  may  pass  it  on  to  others.  Frequencies  of  responses  to  the  various 
options  contained  in  these  items  are  presented  in  Tables  III-4  through  111-7.  It  is  apparent 
from  these  tables  that  62.3%  of  the  respondents  receive  an  original  yellow  copy  of  the  EB, 
that  almost  50%  receive  their  copy  through  inter-office  mail,  that  72%  pass  it  on  to  others, 
and  that  42%  of  those  who  do  simply  hand  it  on  to  a  colleague  rather  than  making  copies. 


Table  III-3.  Frequency  of  Responses  to  Question  5: 
"My  rank/grade  is:"  (Rank/Grade) 

All  Respondents 


1  Rank/Grade 

Frequency 

Percent 

Cumulative 

Percent 

E1-E6 

144 

3.8% 

3.8% 

E7-E9 

140 

3.7% 

7.5% 

W1-W4 

10 

.3% 

7.8% 

01-03 

184 

4.8% 

12.7% 

04-06 

1730 

45.5% 

58.5% 

07  and  above 

111 

2.9% 

61.5% 

GS1-GS7 

115 

3% 

64.5% 

GS8-GS12 

238 

6.3% 

70.8% 

GS/GM13- 

GS/GM15 

641 

16.9% 

87.8% 

SES  GS16-GS18 

145 

3.8% 

91.7% 

Jr  Professional 

35 

.9% 

92.6% 

Mid-level 

Professional 

103 

2.7% 

95.3% 

Sr  Professional 

156 

4.1% 

99.4% 

ClerK/Support 

3 

.1% 

99.5% 

Other 

18 

.5% 

100% 

No  response  to 
this  item 

27 

.7% 

not  included 

Column  Total  & 
Percent 

3800 

100% 

100% 
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Table  III-4.  Frequency  of  Responses  to  Question  9: 
"The  color  of  the  front  page  of  the  EB  I  receive  is  usually:" 


Color 

Frequency 

Percent 

Cumulative 

Percent 

Yellow 

2366 

62.3% 

62.8% 

White 

1399 

36.8% 

100% 

No  response  to 
this  item 

35 

.9% 

not  included 

Column  Total  & 
Percent 

3800 

100% 

100% 

Table  111-5.  Frequency  of  All  Responses  to  Question  10: 
"I  usually  receive  EB  from:" 


Source 

Frequency 

Percent 

Cumulative 

Percent 

CNARS  directly 

508 

13.4% 

13.5% 

Supen/isor 

434 

11.4% 

25.1% 

Interoffice  Mail 

1887 

49.7% 

75.4% 

Coworker 

329 

8.7% 

84.1% 

Common  Area 

42 

1.1% 

85.2% 

US  Mail 

180 

4.7% 

90% 

Fax 

187 

4.9% 

95% 

Other 

187 

4.9% 

100% 

No  Response  to 
this  item 

46 

1.2% 

not  included 

Column  Total  & 
Percent 

3800 

100% 

100% 

Table  111*6.  Frequency  of  Responses  to  Question  12: 
"When  I  finish  with  EB,  i  usually:" 


Question  12 

Frequency 

Percent 

Cumulative 

Percent 

Pass  it  on 

2712 

71.4% 

72% 

Keep  it  on  file 

337 

8.9% 

81% 

Discard  it 

645 

17% 

98.1% 

Other 

72 

1.9% 

100% 

No  response  to 
this  item 

34 

.9% 

not  included 

Column  Total  & 
Percent 

3800 

100% 

100% 

Table  111*7.  Frequency  of  Responses  to  Question  13: 
"When  I  pass  it  on,  I:" 


Question  13 

Frequency 

Percent 

Cumulative 

Percent 

Make  copies 

183 

4.8% 

6.3% 

Attach  it  to  a 
distribution  list 

865 

22.8% 

36.1% 

Hand  mine  to  a 
colleague 

1593 

41.9% 

91.1% 

Other 

259 

6.8% 

100% 

No  response  to 
this  item 

900 

23.7% 

not  included 

Column  Total  & 
Percent 

3800 

100% 

100% 

Responses  to  these  same  survey  items  concerning  distribution  (Questions  9,  10, 
12,  and  13)  were  re-examined  in  more  detail  and  cross-tabulated  with  three  demographic 
variables:  Employer  (Question  2),  Job  (Question  4),  and  Rank/Grade  (Question  5). 
These  results  are  presented  in  Tables  III-8  through  III- 19  and  are  discussed  below.  See 
Appendix  D  for  responses  to  additional  questions. 

1.  Distribution  by  Employer 

Table  III-8  presents  a  cross-tabulation  of  Question  2  (Employer)  by  Question  9 
("The  color  of  the  front  page  of  the  EB  I  receive  is  usually:").  By  this  we  mean  that  each 
response  to  Question  9  is  analyzed  by  the  1 1  different  categories  of  employer  available  to 
the  respondent.  Total  responses  to  these  two  items  reveal  that  approximately  two-thirds  of 
the  respondents  receive  an  original  "yellow-cover"  copy  of  EB  (62.8%,  n  =  2,355),  while 
the  remaining  third  receive  a  reproduction  (37.2%,  n  =  1,397).  In-depth  inspection  of  the 
table  indicates  that  members  of  a  Congressional  Support  Organization  and  those  in  Non- 
Academic  Research  Organizations  receive  the  highest  proportion  of  original  EBs  to  copies. 

Question  10  ("I  usually  receive  EB  from:")  identifies  the  distribution  channels 
through  which  respondents  receive  their  EBs.  Table  III-9  presents  a  breakdown  of 
responses  to  Question  10  by  employer,  indicating  that  across  all  employers  half  of  this 
sample  receive  EB  from  inter-office  mail  (50.3%,  n  =  1,882),  and  only  23.3%  (n  =  872) 
repon  receiving  EB  through  one  of  the  three  identified  CNARS  distribution  channels.  Of 
those  who  receive  their  EB  through  inter-office  mail  rather  than  one  of  the  established 
CNARS  distribution  channels,  the  Marines  appear  to  be  the  most  efficient.  They  report  that 
69,2%  of  their  EBs  come  through  in  this  manner.  As  one  would  expect,  only  21.1%  of  the 
Academic  Community  receives  its  EBs  through  inter-office  mail;  rather,  the  academics 
report  the  highest  percentage  (38.6%)  of  EBs  coming  through  direct  mail. 

Table  III- 10  shows  the  frequency  of  responses  to  Question  12  ("When  I  finish  with 
EB,  I  usually:")  broken  down  by  employer.  Most  respondents,  across  all  employers, 
repon  that  they  pass  EB  on  to  others  (72%,  n  =  2,704).  Those  affiliated  with  the  Marines 
(78.9%,  n  =  30)  and  Air  Force  (78.3%,  n  =  833)  reponed  the  highest  rates  of  this 
response.  Discard  rates  are  highest  (71.4%)  among  members  of  Congress  and  their 
support  staffs.  This  is  not  surprising  when  one  considers  that  each  member  of  Congress 
can  request  a  personally  addressed  copy  of  EB  and  Supplement  without  justification. 


Table  lli-9.  Responses  to  Question  10:  "I  usually  receive  EB  from: 

by  Employer 
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Table  111-10.  Responses  to  Question  12:  "When  I  finish  with  EB,  I  usually:" 

by  Employer 
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Responses  to  Question  13  ("When  I  pass  EB  on  I:"),  when  considered  across  all 
employers,  indicated  that  most  respondents  share  their  EB  with  a  colleague  (54.9%, 
n  =  1,588),  or  attach  it  to  a  distribution  list  (29.8%,  n  =  863).  Table  111-11  presents  a 
complete  breakdown  of  frequencies  to  Question  13  and  Question  2.  The  Coast  Guard  is 
most  likely  to  "hand  EB  to  a  colleague"  (59.1%)  and  those  involved  in  Congressional 
Support  are  most  likely  (50%)  to  "  attach  it  to  a  distribution  list."  However,  30.6%  of  the 
Academic  Community  reports  accomplishing  this  task  by  "making  copies." 

2.  Distribution  by  Job  Category 

Table  III- 12  presents  a  breakdown  of  Question  4  (Job)  by  Question  9  ("The  color 
of  the  front  page  of  the  EB  I  receive  is  usually:").  Responses  to  these  two  items  reveal  that 
all  job  categories  receive  a  higher  proportion  of  yellow  covers  to  white  indicating  that 
approximately  two-thirds  of  the  respondents  receive  an  original  copy  of  EB  (62.9%, 
n  =  2,355),  while  the  remaining  third  receive  a  reproduction  (37.1%,  n  =  1,387).  The 
widest  difference  in  the  proportion  of  originals  to  copies  (70.7%  originals  vs  29.3% 
copies)  occurs  among  those  who  identify  themselves  as  Scholar/Analysts. 

Question  10  ("I  usually  receive  EB  from:")  identified  the  distribution  channels 
through  which  respondents  receive  their  EBs.  Table  III- 13  presents  a  breakdown  of 
responses  to  Question  10  by  job,  indicating  again  that  across  all  jobs  half  of  this  sample 
receive  EB  from  interoffice  mail  (50.3%,  n  =  1,877),  and  only  23.3%  (n  =  869)  report 
receiving  EB  from  one  of  the  three  identified  CNARS  distribution  channels.  The  highest 
percentage  (57.5%)  of  inter-office  mail  copies  are  received  by  Clerical/Administrative 
woricers  and  the  lowest  (21.1%)  by  Non-Government  Management  personnel. 

Table  III- 14  offers  the  frequency  of  responses  to  Question  12  ("When  I  finish  with 
EB,  I  usually:")  broken  down  by  job.  Most  respondents  across  all  jobs  report  that  they 
pass  EB  on  to  others  (72.1%,  n  =  2,697).  Those  holding  jobs  described  as  Manager 
(82.7%,  n  =  948)  and  Policy  Maker  (71.9%,  n  =  256)  reported  the  highest  rates  of 
response  to  this  alternative.  The  lowest  rate  of  "passing  it  on"  was  reported  by  Scholar/ 
Analysts  (59.3%).  The  highest  discard  rate  was  reported  by  Non-Government 
Management  (26.3%). 


Table  111-11.  Responses  to  Question  13:  "When  I  pass  EB  on, 

by  Employer 


nM3 


Column  Total  a  182  863  1588  259  2892 

Averago  Paicont  Across  6.3%  29.8%  54.9%  9%  100% 

Employars 


(Original  Versus  Reproductions  of  EB) 
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Percent  Across  Jobs  62.9%  37.1%  100% 


Table  111-13.  Responses  to  Question  10:  "I  usually  receive  EB  from: 

by  Job 
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Table  111-14.  Responses  to  Question  12:  ’’When  I  finish  with  EB,  I  usually: 

by  Job 


Question  12 

Row  Total  & 
Percent  of  Each 
Job 

356 

9.5% 

1147 

30.6% 

1114 

29.8% 

396 

10.6% 

318 

8.5% 

154 

4.1% 

19 

.5% 

239 

6.4% 

3743 

100% 

Other 

5 

1.4% 

10 

.9% 

21 

1.9% 

21 

5.3% 

4 

1.3% 

3 

1.9% 

1 

8 

3.3% 

72 

1.9% 

Discard  it 

63 

17.7% 

127 

11.1% 

235 

21.1% 

66 

16.7% 

70 

22% 

30 

19.5% 
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26.3% 

43 

18% 

639 

17.1% 

i 
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cj  0) 

62 

5.4% 

79 

7.1% 

74 

18.7% 

23 

7.2% 

ob 

2 

10.5% 

50 

20.9% 

335 

9% 

Pass  it  on  to  others 

256 

71.9% 

948 

82.7% 

779 

69.9% 

235 

59.3% 

221 

69.5% 

108 

70.1% 

12 

63.2% 

138 

57.7% 

2697 

72.1% 

1  Job 

Policy  Maker 

Manager 

Action  Officer 
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n 
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lL 

Clerical/Administrative 

I  Technical  Staff 
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Management 

Other 

Column  Total  & 
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Responses  to  Question  13  ("When  I  pass  EB  on  I;"),  when  considered  across  all 
jobs,  indicated  that  most  respondents  share  their  EB  with  a  colleague  (54.9%,  n  =  1,584), 
or  attach  it  to  a  distribution  list  (29.8%,  n  =  860).  Table  III-15  presents  a  complete 
breakdown  of  frequencies  to  Question  13  and  Question  4.  Action  Officers  are  most  likely 
to  hand  it  to  a  colleague  (69.2%)  and  Managers  seem  to  prefer  attaching  it  to  a  distribution 
list  (40.1%). 

3  .  Distribution  by  Rank/Grade 

In  the  same  manner  as  the  other  cross-tabulations.  Table  III- 16  presents  a 
breakdown  of  Question  5  (Rank/Grade)  by  Question  9  ("The  color  of  the  front  page  of  the 
EB  I  receive  is  usually:").  Responses  to  these  two  items  reveal  the  same  summary  results 
as  the  previous  cross-tabulations.  It  is  interesting  to  note  that  even  though  EB  is  aimed  at 
the  senior  military  and  civilian  executives,  the  highest  proportion  of  original  copies 
(88.6%)  goes  to  Junior  Professionals.  Other  than  this  anomaly,  the  other  proportions  seem 
to  be  in  line  with  the  CNARS  distribution  philosophy. 

Question  10  ("I  usually  receive  EB  from:")  identified  the  distribution  channels. 
Table  HI- 17  presents  a  breakdown  of  responses  to  Question  10  by  rank/grade,  indicating 
again  that  across  all  ranks/grades,  half  of  this  sample  receive  EB  from  interoffice  mail 
(50.4%,  n  =  1,882),  and  only  23.1%  (n  =  862)  report  receiving  EB  from  one  of  the  three 
identified  CNARS  distribution  channels.  Interesting  suppon  for  the  high  proportion  of 
originals  going  to  Junior  Professionals  is  provided  by  the  fact  that  they  also  report  the 
lowest  rate  of  receipt  through  inter-office  mail. 

Table  111-18  offers  the  frequency  of  responses  to  Question  12  ("When  I  finish  with 
EB,  I  usually:")  broken  down  by  rank/grade  indicates  that  over  70%  pass  it  on.  Those  in 
civilian  grades  of  GS1-GS7  (79.8%,  n  =  91)  and  military  ranks  cf  04-06  (76%, 
n  =  1,305)  reported  the  highest  pass-along  rates  among  all  rank/grade  categories.  The 
lowest  rate  of  "passing  it  along"  is  reponed  by  the  Junior  Professionals  (37.1%);  however, 
the  highest  rate  of  discard  is  reported  among  the  SES  and  other  senior  Professionals  (about 
46%). 

Responses  to  Question  13  ("When  I  pass  EB  on  I:"),  when  considered  across  all 
ranks/grades,  indicated  that  most  respondents  who  are  willing  to  share  their  EB  do  so  by 
handing  it  to  a  colleague  (55%)  or  by  attaching  it  to  a  distribution  list  (29.9%). 
Table  111-19  presents  a  complete  breakdown  of  frequencies  to  Question  13  and  Question  5 


Table  111-15.  Responses  to  Question  13:  "When  I  pass  it  on, 

by  Job 
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9.4% 
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33.3%o 

80 

51.3%, 

1584 
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4.2% 

34 

4.1% 

29 

10.9% 

36 

14.8%, 

12 

10.6% 

1 

15 
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Table  111-16.  Responses  to  Question  9:  'The  color  of  the  front  page  of 
the  EB  I  receive  Is  usually:"  by  Rank/Grade 


Rank/Grade 


Yellow 

White 

Row  Total  &  Percent 
of  Each  Rank/Grade 

E1-E6 

97 

67.4% 

47 

32.6% 

144 

3.8% 

E7-E9 

63 

56 

139 

59.7% 

40.3% 

3.7% 

W1-W4 

7 

3 

10 

70% 

30% 

.3% 

01-03 

105 

79 

184 

57.1% 

42.9% 

4.9% 

044)6 

986 

731 

1717 

57.4% 

4^6% 

45.9% 

07andabov« 

68 

43 

111 

61.3% 

38.7% 

3% 

QS1-GS7 

71 

43 

114 

62.3% 

37.7% 

3% 

QSS43S12 

139 

97 

236 

58.9% 

41.1% 

6.3% 

QS/QMIS-OS/OMIS 

426 

210 

636 

67% 

33% 

17% 

SES.aS16-GS18 

118 

27 

145 

81.4% 

18.6% 

3.9% 

Junior  PreftMional 

31 

4 

35 

88.6% 

11.4% 

.9% 

MicHoval  ProfM«ional 

81 

20 

101 

80.2% 

19.8% 

2.7% 

Sonior  Pretesaionai 

123 

28 

151 

81.5% 

18.5% 

4% 

dartt/Suppott 

1 

2 

3 

33.3% 

66.7% 

.1% 

06«ar 

14 

* 

18 

77.8% 

22.2% 

.5% 

CokMim  Total  6  Avaraga 

2350 

1394 

3744 

Paioant  Aooaa  Rank/Qrada 

6Z8% 

37.2% 

100% 
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Table  111-17.  Responses  to  Question  10:  "I  usually  receive  EB  from:" 

by  Rank/Grade 


Rank/ 

Grade 

Queslion  10 

CNARS 

Super- 

Inter- 

CO- 

common 

US  mail 

fax 

Other 

Row 

Visor 

office 

worker 

area 

Total  8 

mail 

Percent 
of  Each 
Rank/ 
Grade 

E1-E6 

32 

14 

64 

6 

1 

3 

10 

11 

141 

22.7% 

9.9% 

45.4% 

4.3% 

.7% 

2.1% 

7.1% 

7.8% 

3.8% 

E7-E8 

16 

0 

88 

7 

1 

0 

10 

0 

140 

11.4% 

6.4% 

62.9% 

5% 

.7% 

0% 

7.1% 

6.4% 

3.7% 

W1-W4 

1 

■■ 

7 

1 

0 

■B 

0 

1 

10 

10% 

70% 

10% 

0% 

0% 

10% 

.3% 

01-03 

10 

30 

00 

20 

1 

4 

10 

0 

183 

10.4% 

16.4% 

40.2% 

10.9% 

.5% 

2.2% 

5.5% 

4.9% 

4.0% 

04-06 

206 

225 

887 

151 

22 

20 

100 

85 

1714 

12% 

13.1% 

51.8% 

8.8% 

1.3% 

1.7% 

6.4% 

5% 

45.0% 

07* 

22 

1 

53 

3 

0 

14 

7 

10 

110 

20% 

.0% 

48.2% 

2.7% 

0% 

12.7% 

6.4% 

0.1% 

2.0% 

QS1- 

11 

11 

76 

6 

1 

1 

5 

4 

114 

QS7 

9.6% 

0.6% 

66.1% 

5.2% 

.9% 

.0% 

4.3% 

3.5% 

3.1% 

Qse- 

26 

26 

116 

25 

1 

10 

21 

10 

237 

GS12 

11.8% 

11% 

48.9% 

10.5% 

.4% 

4.2% 

8.9% 

4.2% 

6.3 

QS/GM 

59 

102 

344 

60 

10 

13 

8 

27 

632 

13-15 

0.3% 

16.1% 

54.4% 

10.9% 

1.6% 

2.1% 

1.3% 

4.3% 

16.0% 

SES.GS 

30 

4 

74 

6 

■■ 

13 

4 

9 

140 

16-18 

21.4% 

2.9% 

5^9% 

4.3% 

KB 

9.3% 

2.0% 

6.4% 

3.7% 

Jr  Prof 

7 

2 

5 

7 

1 

10 

■B 

3 

35 

20% 

5.7% 

14.3% 

20% 

2.9% 

28.6% 

kb 

8.6% 

.0% 

Mid  Prof 

21 

2 

31 

11 

4 

32 

1 

1 

103 

20.4% 

1.9% 

30.1% 

10.7% 

3.0% 

31.1% 

1% 

1% 

2.8% 

Sr  Prof 

44 

7 

44 

15 

BB 

30 

2 

5 

156 

28.2% 

4.5% 

28.2% 

9.6% 

KB 

25% 

1.3% 

3.2% 

4.2% 

Clwfc 

■■ 

■■ 

2 

■■ 

KB 
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■B 
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3 

66.7% 
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KB 

33.3% 

BB 

0% 
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4 

1 

1 

2 

■B 
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■B 

3 

17 
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5.9% 

11.8% 
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KB 
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.5% 
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Table  111-18.  Responses  to  Question  12:  "When  I  finish  with  EB,  I  usually:" 

by  Rank/Grade 


Rank/Grad* 

Quastlon  12: 

Pass  it  on 

Kaep  it  on  tiia 

Discard  it 

Othar 

Row  Total  & 

Parcant 

E1-E6 

94 

12 

34 

3 

143 

65.7% 

8.4% 

23.8% 

2.1% 

3.8% 

E7-E9 

101 

6 

29 

2 

138 

73.2% 

4.3% 

21% 

1.4% 

3.7% 

W1-W4 

9 

0 

1 

0 

10 

90% 

0% 

10% 

0% 

.3% 

01-03 

128 

18 

32 

4 

182 

70.3% 

9.9% 

17.6% 

2.2% 

4.9% 

04-06 

1305 

116 

275 

21 

1717 

76% 

6.8% 

16% 

1.2% 

45.8% 

07  a  abov* 

84 

9 

16 

2 

111 

75.7% 

8.1% 

14.4% 

1.8% 

3% 

GS1-GS7 

91 

9 

12 

2 

114 

79.8% 

7.9% 

10.5% 

1.8% 

3% 

GS8-GS12 

163 

23 

44 

6 

236 

69.1% 

9.7% 

18.6% 

2.5% 

6.3% 

GSA3M13- 

485 

32 

110 

9 

636 

GS/GM1S 

76.3% 

5% 

17.3% 

1.4% 

17% 

SES  GS16- 

88 

15 

38 

3 

144 

GS18 

61.1% 

10.4% 

26.4% 

2.1% 

3.8% 

Jr  Profassional 

13 

11 

■m 

3 

35 

37.1% 

31.4% 

8.6% 

.9% 

Mid-lava) 

51 

30 

19 

3 

103 

Profassional 

49.5% 

29.1% 

18.4% 

^9% 

2.7% 

Sr  Profassional 

83 

44 

19 

10 

156 

53.2% 

28.2% 

12.2% 

6.4% 

4.2% 

Clark/Support 

2 

1 

0 

0 

3 

66.7% 

33.3% 

0% 

0% 

.1% 

Othar 

8 

4 

3 

3 

18 

44.4% 

22.2% 

16.7% 

16.7% 

.5% 

Column  Total  & 

2705 

330 

640 

71 

3746 

Parcant 

72.2% 

8.8% 

17.1% 

1.9% 

100% 

Table  111-19.  Responses  to  Question  13:  "When  I  pass  EB  on,  I:" 

by  Rank/Grade 


RanK/Grade 


SES  OS16- 
GS18 


Mid-laval 

Prafasaioflal 


Sr  Profaasionai 


Clark/Suppott 


Olhar 


Column  Total  & 
Paroanl 


Make  Copies 

Attach  to  a 
distrfeution  list 

Hand  to  a 
collaagua 

Other 

Row  Total  & 
Percent 

E1-E6 

17 

19 

54 

9 

99 

17.2% 

19.2% 

54.4% 

9.1% 

3.4% 

E7-E9 

6 

28 

67 

7 

108 

5.6% 

25.9% 

62% 

6.5% 

3.7% 

GSA3M13- 

27 

150 

284 

45 

506 

GSA3M15 

5.3% 

29.6% 

56.1% 

8.9% 

17.5% 

Jr  Professional 

6 

1 

9 

1 

17 

35.3% 

5.9% 

52.9% 

5.9% 

.6% 

and  shows  that  those  most  apt  to  hand  it  to  a  colleague  are  Clerical/Support  staff  (66.7%), 
while  those  most  likely  to  put  it  on  a  buck  slip  are  SES  or  GS 16- 18  managers  (35.1%). 
Those  most  likely  to  make  copies  are  the  Junior  Professionals  (35.3%). 

4.  Estimated  Audience  Size 

As  noted  earlier,  the  methodology  used  for  distributing  the  survey  and  a  number  of 
questions  included  within  the  instrument  itself,  allowed  the  researchers  to  obtain 
information  about  the  size  and  character  of  the  shadow  audience.  Responses  to  survey 
Question  10  ("I  usually  receive  EB  from:")  were  selected  to  serve  as  the  basis  for 
determining  the  proportion  of  readers  who  receive  EB  via  one  of  the  three  direct 
distribution  channels  (directly  from  the  CNARS  office,  fax,  or  U.S.  mail),  versus  those 
who  receive  EB  some  other  way.  Those  who  reponed  receiving  EB  from  one  of  the 
recognized  distribution  channels  were  considered  "direct"  recipients,  while  those  who 
reported  acquiring  EB  from  other  means  were  labeled  "indirect"  recipients  and  considered 
part  of  the  shadow  audience.  Indirect  recipients,  or  shadow  audience  members,  were  thus 
defined  as  those  who  receive  EB  from  a  supervisor,  through  inter-office  mail,  from  a  co- 
worker,  read  it  in  a  common  area  such  as  a  lunchroom,  or  receive  EB  by  some  other 
method.  Of  the  3,800  respondents  who  answered  this  item,  2,879  (76.9%)  were  classified 
as  indirect  recipients  (Table  III-20). 


Table  111*20.  Frequency  of  Responses  to  Question  10: 
"I  usually  receive  EB  from:" 

Indirect  Recipients  Only 


Sourco 

Frequency 

Percent 

Cumulative  I 

Percent  | 

Supervisor 

434 

15.1% 

15.1% 

Interoffice  Mail 

1887 

65.5% 

80.6% 

Coworker 

329 

11.4% 

92% 

Common  Area 

42 

1.5% 

93.5% 

Other 

187 

6.5% 

100% 

Total 

2879 

100% 

100% 

Using  this  information  we  developed  a  method  of  estimating  the  total  EB  audience 
size,  which  indicated  that  the  true  readership  of  EB  was  much  larger  than  the  number  of 
copies  produced  each  day.  In  calculating  the  estimate  of  the  total  audience  size,  the 


percentage  of  respondents  identified  as  indirect  recipients  (76.9%)  was  used  in  the 
following  formula: 

(Percent  of  indirects  +  100%)  x  Total  press  run  =  Total  Estimated  Audience 
or,  represented  numerically: 

(76.9%  +  100%)  X  8,600  =  15,213. 

The  76.9%  represents  the  percentage  of  readers  over  and  above  the  number  of 
assumed  direct  readers  (8,600),  thus  forming  an  estimated  audience  size  equal  to  176%  of 
the  number  of  copies  produced  each  day.  This  estimated  percentage  of  audience  size  is 
then  multiplied  by  the  number  of  EBs  produced  to  determine  the  estimated  number  of 
people  who  actually  read  EB  each  day.  Using  this  formula  the  figure  of  15,213  total 
readers  emerges  as  the  estimated  size  of  the  EB  audience. 

With  this  estimate  of  EB  audience  population,  a  rate  of  return  for  the  survey  effort 
was  then  calculated.  This  involves  dividing  the  number  of  completed  surveys  received 
(3,800)  by  the  total  estimated  audience  size  (15,213),  which  results  in  a  return  rate  of 
nearly  25%.  Due  to  the  preliminary  nature  of  this  effort,  the  methodological  challenges 
faced  in  surveying  an  unknown  population,  and  the  inability  to  send  surveys  to  specific 
individuals,  the  actual  rate  of  return  can  only  be  approximated.  While  this  figure  of  15,2 13 
total  readers  is  the  first  estimate  ever  offered  based  on  empirical  data,  the  researchers 
acknowledge  that  it  may  be  conservative.  Due  to  the  previously  mentioned  methodological 
difficulty  faced  in  identifying  the  target  sample  and  reaching  shadow  audience  members, 
the  possibility  remains  that  many  EB  shadow  readers  were  not  represented  in  this  estimate. 

Unfortunately,  it  is  not  possible  to  estimate  the  statistical  confidence  of  this  estimate 
of  audience  size,  since  a  confidence  estimate  operates  on  the  principle  that  a  "known" 
population  exists  and  information  is  available  about  it.  In  calculating  confidence  estimates, 
the  researcher  is  either  trying  to  determine  if  the  responses  to  a  survey  item  given  by  the 
sample  can  be  generalized  to  the  population  with  a  minimum  probability  that  those 
responses  occurred  by  chance,  or  to  ensure  that  the  sample  accurately  reflects  the 
population  based  on  some  type  of  demographic  variable.  However,  since  we  have  no  pre¬ 
existing  information  about  the  population  of  all  EB  readers,  it  is  not  possible  to  determine  if 
our  sample  of  respondents  is  truly  representative  of  the  total  population. 

What  this  estimate  does  provide,  however,  is  evidence  that  EB  is  in  fact  reaching  an 
audience  far  larger  than  the  number  of  publications  produced  each  day  and  that  the  true 
estimate  of  the  audience  size  probably  is  much  greater  than  15,213  readers. 
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C .  RESPONSES  TO  EARLY  BIRD  CONTENT  ITEMS 


The  responses  to  survey  items  18, 22, 23,  25,  and  26  concerning  the  content  of  EB 
are  discussed  in  detail  in  the  following  section.  Each  of  these  response  sets  is  cross- 
tabulated  with  the  three  major  demographic  items  of  Employer  (Question  2),  Job  (Question 
4),  and  Grade/Rank  (Question  5),  which  were  explored  earlier.  Tables  of  overall 
frequencies  of  response  are  provided  in  Appendix  E.  Tables  of  frequency  of  responses  to 
Questions  21  and  24  are  provided  in  Appendix  F. 

1 .  Content  by  Employer 

Table  III-21  presents  the  number  and  percent  of  responses  to  Question  18,  which 
addressed  the  amount  of  EB  usually  read  broken  down  by  Employer.  Over  half  (59.3%, 
n  =  2,238)  of  all  respondents  to  these  two  items  read  all  or  more  than  half  of  EB.  Among 
those  in  the  military  community,  respondents  from  the  Army  (65.1%,  n  =  673)  and  Navy 
(62.2%,  n  =  283)  reported  the  highest  ratings  regarding  the  amount  of  EB  read.  Among 
those  from  the  civilian  sector  (both  Government  and  non-Government)  respondents  from 
the  Academic  Community  (71.9%,  n  =  41)  and  those  employed  by  some  "Other” 
organization  not  listed  (61.8%,  n  =  220)  provided  the  highest  ratings. 

Question  23  solicits  responses  regarding  the  topics  of  information  for  which  EB  is  a 
valuable  source.  Those  who  responded  to  this  item  indicated  that  anicles  regarding  DoD 
Organization  and  Budget  (81%,  n  =  3,028)  and  International  Security  Issues  (80.6%, 
n  =  3,017)  were  those  most  well-documented  by  EB.  Table  III-22  provides  a  breakdown 
of  frequencies  for  each  topic  by  employer.  The  least  well-documented  category  of 
information  concerned  Guard  and  Reserve  affairs  with  only  42.5%  of  respondents  agreeing 
or  strongly  agreeing  that  EB  was  a  valuable  source  of  information.  If  we  look  at  the  best 
reported  categories  of  information  (International  Security  and  DoD  Budget)  cross-tabulated 
with  employer,  we  find  that  the  Academic  Community  respondents  were  most  enthusiastic 
about  EB's  coverage  of  International  Security  (94.8%  agreed  or  strongly  agreed)  and  that 
those  in  Non-Academic  Research  were  most  likely  to  repon  that  EB  provided  valuable 
information  concerning  DoD  organization  and  budget  (89.8%  agreed  or  strongly  agreed). 
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Table  lll•21.  Responses  to  Question  18:  "Of  the  articles  in  EB,  I  usually  read: 

by  Employer 
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Table  111-22.  Respondents  Who  Agreed  or  Strongly  Agreed  With  Questions  23A-23J: 
”EB  is  a  valuable  source  of  information  on:"  by  Employer 
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Table  III-23  shows  responses  to  Item  22A,  B,  and  C.  Item  22A  concerns  the 
relevance  to  duty  of  EB  articles.  Analysis  revealed  that  79.6%  (n  =  2,994)  of  those  who 
responded  to  this  item  agreed  or  strongly  agreed  that  EB  presents  duty-relevant  articles 
across  all  employers.  For  those  respondents  from  the  military  community,  individuals 
from  the  Army  (77.7%,  n  =  797)  and  Navy  (77.3%,  n  =  351)  reported  the  highest  duty 
relevance.  Among  the  non-military  respondents  Congressional  Support  Staff  (100%, 
n  =  21)  and  Congress  (99.1%,  n  =  1 15)  reported  the  highest  rates  of  agreement.  Lowest 
ratings  of  duty  relevance  were  reported  by  the  Coast  Guard  (66.6%)  and  the  Marines 
(67.5%). 

Question  22B,  rating  EB's  contribution  to  personal  knowledge  of  DoD  policies, 
programs,  and  activities,  resulted  in  88.9%  (n  =  3,308)  of  respondents  agreeing  or 
strongly  agreeing  to  this  item  across  all  employers.  Those  from  the  Marines  (94.8%, 
n  =  37)  and  Air  Force  (87.9%,  n  =  936)  and  the  non-Service  organizations  such  as  the 
Academic  Community  (94.7%,  n  =  54)  and  "Other”  unspecified  organizations  (94.3%) 
reported  the  highest  rates  of  agreement.  Question  22C,  regarding  the  ability  of  EB  to 
inform  individuals  on  the  results  of  DoD  policy  decisions,  indicated  that  81.2%  (n  =  3,021) 
agreed  or  strongly  agreed  across  all  employers.  Among  the  Services,  those  from  the  Navy 
(82.4%,  n  =  373)  and  Air  Force  (81.1%,  n  =  864)  gave  EB  the  highest  ratings  in  this  area, 
while  non-military  organizations  reponed  the  highest  ratings  among  those  categorized  as 
belonging  to  "Other"  organizations  (88%,  n  =  277)  and  Congress  (83.8%,  n  =  98). 
Table  III-23  presents  a  complete  breakdown  of  respondents  who  agreed  or  strongly  agreed 
to  these  three  items  by  employer. 

Table  III-24  provides  detailed  frequencies  of  response,  by  employer,  for  those  who 
agreed  or  strongly  agreed  with  survey  items  24A-H.  These  items  requested  the  rating  of 
EB  as  an  effective  aid  in  decision-making  in  eight  topic  areas:  R&D,  Operations,  Logistics, 
Budget,  Procurement/Acquisiiion,  Public  Affairs/Legislative,  Intelligence  and  Other  DoD 
Issues.  Overall,  the  respondents  who  completed  these  ratings  considered  EB  most 
effective  in  aiding  decisions  on  Public  Affairs/Legislative  issues  (50.8%,  n  =  1,842)  and 
Budget  concerns  (37.4%,  n  =  1,349).  When  analyzed  with  regard  to  employer,  we  find 
that  the  highest  level  of  agreement  or  strong  agreement  concerning  EB  as  effective  in  aiding 
decision-making  on  Public  Affairs/Lcgislative  (69.5%)  and  on  Budget  (70.5%)  came  from 
members  of  Congress.  The  lowest  level  of  agreement  concerning  Public  Affairs/ 
Legislative  decisions  came  from  the  Coast  Guard  (40.7%)  and  the  lowest  level  of 
agreement  about  suppon  for  budget  decisions  came  from  the  Marines  (23. 1%). 


Table  111-23.  Respondents  Who  Agreed  or  Strongly  Agreed  With  Questions  22A-22C 

by  Employer 
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Table  111-24.  Respondents  Who  Agreed  or  Strongly  Agreed  to  Questions  24A-24H: 
"EB  is  an  effective  aid  in  making  decisions  regarding:"  by  Employer 
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The  frequency  of  responses  for  each  employer  group  to  Question  25 A,  B,  and  C 
are  presented  in  Table  III-25.  Question  25A  asked  respondents  to  rate  the  ability  of  EB  to 
help  them  set  their  daily  agenda.  Only  9%  of  respondents  either  agreed  or  strongly  agreed 
with  this  item  (9%,  n  =  330)  across  employers.  Item  25B  indicates  that  EB  does  a  better 
job  at  helping  readers  gather  the  information  they  need  to  do  their  jobs  well.  Across  all 
employer  groups  51.2%,  n  =  1,905  agreed  or  strongly  agreed  that  this  was  the  case. 
Those  in  non-military  organizations  rated  this  item  substantially  higher  than  those  from 
military  organizations,  with  respondents  from  the  Academic  Community  (92.4%,  n  =  49) 
and  Congressional  Support  (85%,  n  =  17)  providing  noticeably  greater  ratings  than  the 
Navy  (46.6%,  n  =  210)  or  Army  (45.5%,  n  =  465).  Nearly  half  of  the  respondents 
indicated  on  Question  25C  that  EB  also  helps  them  understand  the  effect  of  their  decisions 
and  actions  on  public  opinion  (49.3%,  n  =  1,823)  across  all  employers.  Response  rates 
were  almost  equally  distributed  across  employer  categories. 

Table  III-26  provides  the  frequency  breakdown  of  the  overall  usefulness  of  EB 
rating  by  employer  category.  Results  indicated  94.6%  (n  =  3,456)  of  respondents  to 
Question  26  either  agreed  or  strongly  agreed  that  EB  is  a  useful  publication.  Military 
personnel  from  the  Navy  (94.4%,  n  =  416)  and  non-military  personnel  in  the  Academic 
Community  (100%,  n  =  54),  Congress  (100%,  n  =  115),  and  Congressional  Support 
(100%,  n  =  21)  provided  the  highest  ratings. 

2.  Content  by  Job 

Table  III-27  presents  the  number  and  percent  of  responses  to  Question  18,  which 
addressed  the  amount  of  EB  usually  read  broken  down  by  job.  Over  half  (59.2%, 
n  =  2,226)  of  all  respondents  reported  reading  more  than  half  or  all  of  EB  regularly.  Of 
this  group,  those  identifying  themselves  as  Non-Government  Managment  represented  the 
highest  rate  of  interest  in  EB  (78.9%)  and  those  calling  themselves  Scholar/Analysts 
reported  the  lowest  index  of  interest  in  EB. 

Table  in-28  provides  a  breakdown  of  frequencies  for  topics  usually  covered  in  EB 
by  job  of  the  respondent.  Question  23  asks  the  respondent  to  rate  the  value  of  EB  as  a 
source  of  information  on  the  basis  of  a  five-point  scale  ranging  from  strongly  agree 
to  strongly  disagree.  The  topics  are  shown  across  the  top  of  the  table.  Those  who 
responded  to  this  item  indicated  that  articles  regarding  DoD  Organization  and  Budget 


Table  111-26.  Respondents  Who  Agreed  or  Strongly  Agreed  with  Question  26: 
"Overall,  I  find  EB  a  useful  publication"  by  Employer 
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Table  111-27.  Responses  to  Question  18:  "Of  the  articles  In  EB,  I  usually  read: 

by  Job 


Row  Total  & 
Percent  of 
Each  Job 

357  1 

9.5%  1 

CM  BS 
tA  <0 

^  d 

w  3* 

CM  00 

CM 

S  «o 

CO  o 

320 

8.5% 

155 

4.1% 

o>  3^ 
u> 

eu  SS 

CO  3$ 

^  o 
eo 

m 

None 

-A 

^3® 

CO 

«> 

B 

8 

.2% 

• 

Headlines 

Only 

« t 

12 

1.1% 

1 

9 

2.8% 

2 

1.3% 

1 

5.3% 

3 

1.2% 

47 

1.2% 

• 

• 

s 

One  or  Two 

m  S' 
8  2 

23 

5.6% 

15 

4.7% 

9 

5.8% 

1 

5.3% 

7 

2.9% 

140 

3.7% 

• 

.8 

u 

m 

a 

Less  than  Hall 

195 

16.9% 

165 

14.7% 

1 

36 

11.3% 

20 

12.9% 

2 

10.5% 

42 

17.4% 

596 

15.8% 

• 

About  HaH 

60 

16.6% 

8^5 

S2g 

CM 

98 

24.6% 

68 

21.3% 

23 

14.8% 

og 

54 

22.3% 

749 

19.9% 

• 

More  than 
HaH 

8^ 

^8 

453 

39.3% 

474 

42.2% 

^  5 

118 

36.9% 

71 

45.8% 

10 

52.6% 

75 

31% 

1452 

38.6% 

100 

28% 

E 

219 

19.5% 

%&91 

59 

73 

22.8% 

29 

18.7% 

5 

26.3% 

60 

24.8% 

2? 

*^8 

• 

1 

1  PoHcy  Maker 

1 

1 

1  Action  Officer 

Scholar/ 

Analyst 

i 

al 

Si 

1 

c 

1 

Non- 

Government 

Management 

Other 

Column  Total 
&  Average 
Percent 

Across  Jobs 

• 

III-34 


Percent 


Table  111-28.  Respondents  Who  Agreed  or  Strongly  Agreed  with  Questions  23A-23J: 
"EB  Is  a  valuable  source  of  Information  on:”  bv  Job 
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(81%,  n  =  3,019)  and  International  Security  Issues  (80.5%,  n  =  3,011)  were  the  most 
adequately  documented  topics  across  all  jobs  with  very  little  variation  in  frequency  or 
percentage  among  the  job  categories. 

Table  III-29  presents  a  complete  cross-tabulation  by  job  of  respondents  who  agreed 
or  strongly  agreed  with  items  22A-C.  Overall,  the  table  revealed  that  79.7%  (n  =  2,987)  of 
those  who  responded  to  item  22A  regarding  the  duty  relevance  of  EB  articles  agreed  or 
strongly  agreed  across  all  jobs,  with  Non-Govemment  Management  (94.8%,  n  =  18)  and 
Scholar/Analysts  (90.4%,  n  =  357)  reponing  the  highest  rates  of  agreement. 

Question  22B,  rating  EB's  contribution  to  personal  knowledge  of  DoD  policies, 
programs,  and  activities,  resulted  in  an  average  of  89%  of  respondents  agreeing  or  strongly 
agreeing  to  this  item  across  all  jobs  with  those  described  as  holding  Technical  jobs  (90.9%, 
n  =  140)  and  Scholar/Analysts  (90.9%,  n  =  359)  reporting  the  highest  rates  of  agreement. 

Question  22C,  rating  the  ability  of  EB  to  inform  individuals  on  the  results  of  DoD 
policy  decisions,  indicated  that  81.2%  (n  =  3,011)  agreed  or  strongly  agreed  with  this 
statement  across  all  jobs.  Action  Officers  (82.1%,  n  =  917)  and  those  in  some  "Other"  job 
category  not  identified  by  the  available  alternatives  (83.8%,  n  =  201)  reported  the  highest 
rate  of  agreement  with  this  item. 

Table  III-30  provides  a  detailed  cross-tabulation  of  frequencies  and  percentages  of 
response  by  job  to  eight  areas  of  military  decision-making:  R&D,  Operations,  Logistics, 
Budget,  Procurement/ Acquisition,  Public  Affairs/Legislative,  Intelligence,  and  Other  DoD 
Issues.  Overall,  the  respondents  considered  EB  most  effective  in  supponing  decisions 
concerning  Public  Affairs/Legislative  issues  (50.8%,  n  =  1,834)  and  Budget  (37.5%, 
n  =  1,346). 

Survey  question  25A  (Table  III-31)  asked  respondents  to  rate  the  ability  of  EB  to 
help  them  set  their  daily  agenda.  Approximately  9%  of  these  respondents  either  agreed  or 
strongly  agreed  with  this  item  (8.9%,  n  =  329)  across  jobs.  Responses  to  item  25B 
indicate  that  EB  does  better  at  helping  readers  gather  the  information  they  need  to  do  their 
jobs  well.  Across  all  job  categories,  51.1%  (n  =  1,898)  of  respondents  agreed  or  strongly 
agreed  with  this  statement.  Nearly  half  of  the  respondents  indicated  that  EB  also  helps 
them  understand  the  effect  of  their  decisions  and  actions  on  public  opinion  (49.3%, 
n=  1,818)  for  all  jobs. 
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Table  111-29.  Respondents  Who  Agreed  or  Strongly  Agreed  With  Questions  22A-22C 

by  Job 


Table  111-30.  Respondents  Who  Agreed  or  Strongly  Agreed  to  Questions  24A-24H: 
”EB  is  an  effective  aid  in  making  decisions  regarding:"  by  Job 
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Table  III-32  (Question  26)  provided  an  overall  usefulness  rating  of  EB  and 
indicated  that  across  all  jobs  94.6%  (n  =  3,446)  of  these  respondents  either  agreed  or 
strongly  agreed  that  EB  is  a  useful  publication. 

3.  Content  by  Rank/Grade 

Table  III-33  presents  the  number  and  percent  of  responses  to  Question  18,  which 
addressed  the  amount  of  EB  usually  read  broken  down  by  rank/grade.  Over  half  (59.2%, 
n  =  2,232)  of  all  respondents  read  more  than  half  or  all  of  EB  across  all  rank/grade 
categories.  The  highest  rates  of  positive  response  occurred  among  officer  grades  of  07  and 
higher  (69.3%,  n  =  73),  and  E7-E9  (67%,  n  =  93). 

Question  23  was  designed  to  gather  information  regarding  the  topics  of  information 
for  which  readers  find  EB  a  valuable  source.  Table  III-34  provides  a  breakdown  of 
frequencies  and  percentages  for  each  information  topic  by  rank/grade.  The  following 
categories  of  information  were  listed:  International  Security  Issues,  Military  Balance/ 
Threat,  DoD  Manpower  and  Personnel,  Operations  and  Readiness,  R&D,  Guard  and 
Reserve  affairs,  DoD  and  the  Environment,  DoD  Organization  and  Budget,  DoD  Special 
Operations,  and  Other  DoD  Issues.  Those  who  responded  to  this  item  indicated  that 
articles  regarding  DoD  Organization  and  Budget  (80.9%,  n  =  3,018)  and  International 
Security  Issues  (80.5%,  n  =  3010)  were  most  adequately  documented  in  EB  across  all 
ranks/grades. 

Table  III-35  presents  a  complete  breakdown  of  respondents  who  agreed  or  strongly 
agreed  to  items  22A-22C  by  rank/grade.  Item  22A,  regarding  the  duty  relevance  of  EB 
articles  revealed  that  79.4%  (n  =  2,979)  agreed  or  strongly  agreed  across  all  ranks/grades, 
with  non-Govemment  Mid-level  Professionals  (97%,  n  =  100)  and  those  holding  positions 
categorized  as  "Other"  (94.4%,  n  =  17)  reporting  the  highest  rates  of  agreement.  Question 
22B,  concerning  EB's  contribution  to  knowledge  of  DoD  policies,  programs,  and 
activities,  resulted  in  88.9%  (n  =  3,297)  of  respondents  agreeing  or  strongly  agreeing 
across  all  ranks/grades.  Disregarding  Qerks  and  Support  personnel  because  of  their 
extremely  small  representation  (n  =  3),  Senior  Professionals  showed  the  highest  level  of 
agreement  (95.5%,  n  =  149)  and  E7-E9  reported  the  lowest  (79.2%,  n  =  1 10).  Question 
22C,  concerning  the  ability  of  EB  to  inform  individuals  on  the  results  of  DoD  policy 
decisions,  indicated  that  81.2%  (n  =  3,011)  agreed  or  strongly  agreed  across  all 
ranks/grades  with  Senior  Professionals  reponing  the  highest  level  of  agreement  (85.9%, 
n  =  134)  and  Junior  Professionals  reporting  the  lowest  (71.4%,  n  =  25). 


Table  111-32.  Respondents  Who  Agreed  or  Strongly  Agreed  With  Question  26: 
"Overall,  I  find  EB  a  useful  publication"  by  Job 
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Table  111-33.  Responses  to  Question  18:  "Of  the  articles  in  EB,  I  usually  read:' 

by  Rank/Grade 


E1-E6 


E7-E9 


W1-W4 


01-03 


Column 

Tow* 


All 

More  than 
hall 

38 

50 

26.4% 

34.7% 

44 

49 

31.7% 

35.3% 

1 

3 

10% 

30% 

One  or 
two 

Only  the 
headlines 

None 

Row 

Total  & 
Percent 

8 

7 

0 

144 

5.6% 

4.9% 

0% 

3.8% 

4 

0 

0 

139 

2.9% 

0% 

0% 

3.7% 

0 

2 

0 

10 

0% 

20% 

0% 

.3% 

7 

6 

2 

184 

3.8% 

3.3% 

1.1% 

4.9% 

07  8 

34 

43 

22 

10 

2 

above 

30.8% 

38.7% 

19.8% 

9% 

1.8% 

QSM3M13 

118 

251 

119 

112 

33 

5 

2 

640 

QS/QMIS 

18.4% 

39.2% 

18.6% 

17.5% 

5.2% 

.8% 

.3% 

17% 

20 

27 

19.4% 

26.2% 

30 

33 

19.2% 

21.2% 

3 

WBM 

100% 

KSil 

6 

4 

33.3% 

22.2% 

744 

596 

19.7% 

15.8% 
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Table  111-34.  Respondents  Who  Agreed  or  Strongly  Agreed  to  Questions 
23A-23J:  "EB  is  a  valuable  source  of  information  on:"  by  Rank/Grade 


Rutkf 

Grad* 

Q23A 

m 

Q23C 

0230 

Q23E 

Q23F 

Q23G 

Q23H 

m 

Q23J 

Iniima- 

terM 

Spcwily 

mart 

Batancp 

OoO 

Porpen- 

nol 

Op«ra- 

tarai 

Rppd- 

Int44 

RSO 

QuivdO 

Rpmcvm 

OoOOeO 

8 

Envirpn- 

riMni 

OoO 

Organi- 

MPan 

6 

Budgpt 

Spacial 

Opara- 

liona 

OPwr 

Ei-e6 

116 

123 

107 

102 

71 

90 

116 

89 

30 

61.1% 

66% 

74.6% 

715% 

745% 

50% 

705% 

81.7% 

62.7% 

54.0% 

E7-E9 

96 

106 

101 

91 

92 

S3 

81 

103 

51 

28 

705% 

765% 

735% 

66.9% 

085% 

38.4% 

58.7% 

745% 

375% 

40.1% 

Wl-VW 

6 

6 

6 

6 

6 

4 

6 

6 

4 

3 

60% 

80% 

60% 

60% 

60% 

40% 

60% 

80% 

40% 

50% 

01-<» 

146 

140 

134 

118 

118 

71 

130 

154 

70 

32 

60.4% 

7S5% 

735% 

645% 

04,4% 

365% 

665% 

845% 

435% 

47.1% 

044)6 

1441 

1306 

W7 

1066 

1126 

676 

1147 

1405 

664 

325 

83.6% 

755% 

76% 

635% 

655% 

39.4% 

065% 

615% 

38.1% 

555% 

076 

96 

69 

67 

65 

73 

56 

85 

93 

44 

28 

■OOM 

66.9% 

62.4% 

705% 

605% 

065% 

63.7% 

78.7% 

08.1% 

40.7% 

625% 

031- 

83 

07 

72 

60 

77 

70 

63 

09 

35 

037 

755% 

685% 

65.4% 

73.4% 

70.7% 

045% 

75.4% 

035% 

625% 

036- 

173 

180 

173 

179 

1S4 

115 

153 

167 

124 

00 

0312 

73.9% 

60.1% 

735% 

765% 

66.1% 

40.1% 

655% 

755% 

53% 

545% 

OSfOM 

463 

460 

435 

307 

372 

263 

406 

506 

273 

119 

13- 

OSrOM 

IS 

765% 

76.6% 

66.7% 

625% 

66.7% 

415% 

045% 

80% 

44.1% 

505% 

3ES 

111 

104 

110 

96 

31 

74 

97 

110 

02 

30 

0316- 

0316 

765% 

71.7% 

765% 

675% 

735% 

51.1% 

805% 

60% 

42.7% 

655% 

Jr 

26 

26 

20 

10 

23 

10 

15 

24 

12 

6 

ProM- 

MMt 

60% 

765% 

Hi 

665% 

60.7% 

305% 

45.4% 

705% 

365% 

60% 

70 

74 

66 

68 

69 

40 

36 

■31 

40 

16 

77.4% 

725% 

075% 

045% 

685% 

455% 

345% 

H 

40% 

50% 

Sr 

130 

117 

117 

1l» 

112 

64 

134 

04 

25 

Prpfii 

a6J% 

77% 

775% 

605% 

73.7% 

425% 

iQl 

88.1% 

425% 

605% 

OmW 

1 

3 

3 

3 

3 

3 

2 

2 

3 

3 

Support 

335% 

100% 

100% 

100% 

100% 

100% 

605% 

605% 

100% 

100% 

Qtwr 

t7 

14 

13 

11 

7 

3 

6 

13 

B 

945% 

635% 

725% 

61.1% 

305% 

17.7% 

365% 

725% 

00% 

3010 

2674 

2763 

2426 

2445 

1560 

2428 

3010 

605% 

765% 

735% 

88.1% 

085% 

425% 

665% 

605% 

KB: 
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Table  111-35.  Respondents  Who  Agreed  or  Strongly  Agreed  to  Questions  22A- 

22C  by  Rank/Grade 


Rank/Grad* 

Q22A 

Q22B 

Q22C 

E8  praaenta  artides  relevant 

EB  increases  my  knowledge 

EB  gives  me  information  on 

• 

to  my  duties 

of  OoO  policies,  programs 

the  results  of  OoO  policy 

and  adivilies 

decisions 

E1-E6 

70 

110 

115 

40% 

83.3% 

80.4% 

E7-E9 

78 

110 

107 

55% 

79.2% 

77% 

A 

W1-W4 

6 

8 

8 

w 

60% 

80% 

80% 

01-03 

143 

165 

148 

78.2% 

01.2% 

81.7% 

044)6 

1440 

1407 

1303 

83.4% 

80% 

82.7% 

• 

07  4  abova 

07 

101 

03 

87.3% 

90.0% 

84.5% 

GS1-GS7 

30 

05 

80 

35.5% 

85.6% 

80.0% 

QS8-GS13 

150 

215 

180 

64.7% 

01.0% 

80.5% 

• 

GIS/QM13-QS/QM1S 

523 

568 

504 

81.0% 

89% 

79% 

SES  OS16-QSie 

136 

128 

112 

03.8% 

88.3% 

77.3% 

Jr  Pretaaaional 

33 

33 

25 

• 

04.3% 

04.3% 

71.4% 

Md-iaval  Profaaaional 

100 

00 

77 

07% 

87.3% 

74.7% 

Sr  Prolaaaionai 

147 

140 

134 

04.2% 

05.5% 

85.9% 

Ctaik/Support 

2 

3 

3 

• 

66.6% 

100% 

100% 

OOiar 

17 

16 

14 

04.4% 

88.0% 

77.8% 

Cohimn  Total  4  Poreant 

2070 

3297 

3011 

70.4% 

88.0% 

81.2% 
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Table  III-36  provides  a  detailed  frequency  of  responses  by  rank/grade  to  eight  areas 
of  decision-making.  Survey  items  24A-H  requested  the  rating  of  EB  as  an  effective  aid  in 
decision-making  in  eight  different  topic  areas:  R&D,  Operations,  Logistics,  Budget, 
Procurement/Acquisition,  Public  Affairs/Legislative,  Intelligence  and  Other  DoD  Issues. 
Across  all  ranks/grades,  the  respondents  considered  EB  most  effective  as  a  decision  aid  in 
the  area  of  Public  Affairs/Legislative  issues  (50.8%,  n  =  1,837)  and  Budget  concerns 
(37.3%,  n  =  1,344).  In  regard  to  Public  Affairs,  senior  professionals  indicated  most 
agreement  (64.3%,  n  =  90)  and  E7-E9  reported  the  least  (43.5%,  n  =  57).  When 
considering  the  Budget  area.  Senior  Professionals  again  reported  the  highest  level  of 
agreement  (57.1%,  n  =  79)  and  E7-E9  were  again  lowest  in  agreement  (25.2%,  n  =  32) 

The  frequency  of  responses  for  each  rank/grade  to  items  25A-25C  are  presented  in 
Table  III-37.  Survey  question  25 A  asked  respondents  to  rate  the  ability  of  EB  to  help  them 
set  their  daily  agenda.  Only  9%  of  these  respondents  either  agreed  or  strongly  agreed  w'ith 
this  item  (8.8%,  n  =  327)  across  rank/grade.  Item  25B  indicates  that  EB  does  a  better  job 
at  helping  readers  gather  the  information  they  need  to  do  their  jobs  well  (51%,  n  =  1,892) 
across  all  ranks/grades.  Nearly  half  of  the  respondents  indicated  that  EB  also  helps  them 
understand  the  effect  of  their  decisions  and  actions  on  public  opinion  (49.3%,  n  =  1,818) 
for  all  ranks/grades. 

Table  III-38  for  Question  26  provides  a  frequency  breakdown  of  overall  usefulness 
ratings  of  EB  by  rank/grade.  The  respondents  indicated  that  94.7%  (n  =  3,446)  of  these 
respondents  either  agreed  or  strongly  agreed  that  EB  is  a  useful  publication  across  all 
ranks/grades  with  the  highest  level  of  agreement  among  the  Senior  Professionals  (99.3%, 
n  -  151)  and  the  lowest  level  occurring  among  military  officers  07  and  above  (40.1%, 
n  =  99). 
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Table  111-36.  Respondents  Who  Agreed  or  Strongly  Agreed  to  Questions  24A 
24H:  "EB  is  an  effective  aid  in  making  decisions  regarding:"  by  Rank/Grade 


Rank/ 

1  Orada 

Q24A 

Q24B 

Q24C 

0240 

Q24E 

Q24F 

Q24G 

Q24H 

R&O 

Opera¬ 

tions 

Logisiics 

Budgel 

Procure¬ 

ment 

Public 

Affairs/ 

Lesgisla- 

live 

Intelli¬ 

gence 

Other 

OoO 

issues 

E1-E6 

31 

49 

43 

51 

47 

71 

45 

20 

23.3% 

37.1% 

32.6% 

38.6% 

35.6% 

53.8% 

34.9% 

3^3% 

E7-E0 

22 

37 

31 

33 

32 

57 

CD 

CM 

6 

16.7% 

26.3% 

23.6% 

25.2% 

24.4% 

43.5% 

21.7% 

1^7% 

W1-W4 

1 

5 

3 

4 

1 

3 

4 

1 

10% 

50% 

30% 

40% 

10% 

30% 

40% 

25% 

01-03 

38 

56 

52 

61 

55 

80 

46 

8 

21.6% 

31.7% 

29.5% 

34.9% 

31.4% 

50.6% 

26.2% 

12.9% 

04-06 

330 

400 

463 

642 

514 

885 

383 

141 

20% 

28.9% 

27.3% 

37.8% 

30.3% 

52% 

22.9% 

27.3% 

07  6 

32 

36 

40 

48 

41 

70 

29 

11 

above 

30.2% 

35.2% 

37.4% 

44.8% 

38.7% 

64.2% 

27.6% 

33.3% 

QS1-GS7 

32 

44 

35 

34 

39 

40 

41 

17 

31.1% 

41.9% 

33.7% 

32.7% 

37.5% 

47.1% 

40.2% 

36.2% 

GS8- 

56 

81 

65 

73 

71 

104 

57 

19 

GS12 

26.3% 

37.5% 

30.4% 

33.9% 

3^6% 

48.2% 

27.5% 

23.2% 

GS/GM13 

132 

165 

161 

206 

101 

101 

124 

40 

OS/GMIS 

21.6% 

26.9% 

26.3% 

33.0% 

31.3% 

44.2% 

20.7% 

20.9% 

SES 

32 

28 

33 

48 

45 

69 

26 

7 

GS16- 

GS18 

23.2% 

20.5% 

24% 

34.8% 

3^6% 

50% 

19.2% 

20% 

JrProtaa- 

10 

6 

6 

16 

15 

19 

9 

2 

aionai 

32.3% 

10.3% 

10.3% 

51.6% 

48.4% 

61.3% 

30% 

25% 

Mid4aval 

34 

32 

28 

40 

39 

49 

26 

8 

Profes¬ 

sional 

36.9% 

34.8% 

30.8% 

44% 

42.9% 

5^1% 

27.7% 

30.7% 

Sr  Profes- 

69 

54 

50 

79 

73 

90 

43 

10 

sional 

51.1% 

40% 

36.6% 

57.1% 

53.6% 

64.3% 

31.9% 

31.3% 

Clerk/ 

2 

2 

2 

2 

2 

1 

2 

2 

Support 

66.7% 

66.6% 

66.7% 

66.7% 

66.3% 

33.3% 

66.7% 

66.7% 

Other 

5 

5 

4 

5 

7 

10 

2 

2 

29.4% 

31.3% 

25.1% 

31.3% 

43.8% 

58.8% 

11.8% 

50% 

Column 

635 

1002 

1016 

1344 

1172 

1837 

873 

294 

Total  6 
Peroent 

23.2% 

30.3% 

28.3% 

37,3% 

3Z5% 

50.8% 

24.6% 

25.5% 
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Table  111-37.  Respondents  Who  Agreed  or  Strongly  Agreed  to 
Questions  25A-25C:  "EB  helps  me:"  by  Rank/Grade 


Rank/Grid* 


GSS-GS12 


GS/GM13-GSX3M15 


SES  GS16-GSt8 


Jr  Prefassionai 


Mid-laval  Profassional 


Sr  Profassional 


CIcik/Support 


Other 


Column  Total  &  Poroent 


Q25A 


Sat  my  daily  agenda 


Q25B 

Q25C 

Gather  the  inlormation  1 

Understand  the  effect  of 

need  to  do  my  job  well 

my  dacisions/actions  on 
public 
opinion 

34 

54 

24.8% 

39.4% 

38 

55 

28.8% 

41% 

4 

4 

40% 

40% 

80 

90 

44.2% 

495% 

869 

905 

SO.5% 

52.7% 

69 

64 

62.7% 

60.3% 

21 

53 

29.6% 

49.1% 

106 

85 

46.8% 

37.8% 

316 

306 

49.6% 

48.4% 

100 

82 

70.4% 

58.1% 

29 

12 

82.8% 

36.4% 

78 

34 

78% 

34.7% 

127 

67 

83.6% 

46.9% 

2 

2 

66.6% 

66.6% 

17 

5 

94.5% 

27.8% 

1892 

1818 

51% 

495% 

Table  111-38.  Respondents  Who  Agreed  or  Strongly  Agreed  to  Question  26: 
"Overall,  I  lind  EB  a  useful  publication"  by  Rank/Grade 


Rank/Grade 

Question  26 

E1-E6 

120 

8802% 

E7-E9 

119 

88.8% 

W1-W4 

8 

80% 

01-03 

163 

91.1% 

04-06 

1596 

95.2% 

07  &  above 

99 

40.1% 

GS1-GS7 

97 

91.5% 

GS8-GS12 

210 

92.5% 

GS/GM13-GS/GM15 

562 

94.5% 

SES  GS16-GS18 

137 

98.6% 

Jr  Professional 

100% 

Mid-level  Professional 

99 

98% 

Sr  Professional 

151 

99.3% 

Clerk/Support 

3 

100% 

Other 

18 

100% 

Column  Total  and  Average  Percent 

3446 

94.7% 
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IV.  RESULTS  OF  CURRENT  NEWS  SUPPLEMENT  SURVEY 


Survey  items  27  through  34  requested  information  from  readers  of  Current  News 
Supplement  (Supplement).  The  following  section  describes  the  demographics  of  those 
who  responded  to  these  items,  their  frequency  of  receipt  of  the  publication,  as  well  as  their 
responses  to  the  survey  questions  regarding  the  content  of  Supplement. 

A.  DEMOGRAPHICS 

Survey  respondents  were  requested  to  answer  Questions  27-34  only  if  they  read 
Supplement  in  addition  to  EB.  The  number  of  Supplement  readers  among  this  sample  of 
respondents  was  determined  by  selecting  all  those  who  provided  any  response  to  Question 
27  which  inquired  as  to  how  often  they  received  the  Supplement.  Of  the  3,800  total  survey 
respondents,  1,967  also  indicated  that  they  received  the  Supplement  (Table  IV-1).  The 
most  frequent  response  was  "every  day"  (13.7%,  n  =  521)  and  the  least  frequent  was  2.5% 
(n  =  96),  who  received  the  Supplement  only  once  a  month.  While  this  number  of  reported 
Supplement  readers  far  exceeds  the  650  copies  produced  daily,  no  reliable  estimate  of  the 
"shadow"  Supplement  audience  could  be  calculated,  as  it  was  for  EB.  The  methods  used 
to  estimate  EB's  shadow  readership  involved  the  use  of  questions  specifically  addressing 
distribution,  but  no  comparable  questions  were  included  in  the  survey  pertaining  to 
Supplement.  Future  survey  efforts  involving  this  audience  should  include  questions 
regarding  mode  of  receipt  in  order  to  determine  how  many  readers  are  direct  versus  indirect 
Supplement  recipients. 

Table  IV-2  provides  a  frequency  distribution  for  Employer  groups  responding  to 
the  Supplement  items.  In  terms  of  employer  or  organizational  affiliation  (Question  2), 
individuals  from  the  Air  Force  (28.2%,  n  =  554)  and  Army  (26.9%,  n  =  530)  were  the 
most  frequent  recipients  of  the  Supplement  among  the  Armed  Forces  sector,  and  DoD 
Staff/Agency  employees  (14.5%,  n  =  286)  the  most  frequent  recipients  among  the  civilian 
community.  The  fact  that  the  Air  Force  yielded  the  highest  number  of  recipients  may  be  an 
artifact  created  by  CNARS'  previous  affiliation  with  the  Air  Force.  While  this  may  explain 
the  preponderance  of  copies  going  to  Air  Force  readers,  it  is  not  a  justification;  future 


Table  IV*1.  Frequency  of  Responses  to  Question  27: 
"I  usually  receive  Current  News  Supplement" 

Ail  Respondents 


How  often 
Supplement  is 
Read 

Frequency 

Percent 

Cumulative 

Percent 

Every  day 

521 

13.7% 

26.5% 

More  than  once  a 
week 

440 

11.6% 

48.9% 

Once  a  week 

320 

8.4% 

65.1% 

Twice  a  month 

174 

4.6% 

74% 

Once  a  month 

96 

2.5% 

78.9% 

Rarely 

416 

10.9% 

100% 

No  response  to 
this  item  (non- 
Supplement 
readers) 

1833 

48.2% 

not  included 

Column  Total  & 
Percent 

3800 

100% 

100% 

IV-2 


Table  IV-2.  Frequency  of  Responses  to  Question  2: 
"I  work  for:”  (Employer) 

Supplement  Readers  Only 


1  Employer 

Frequency 

Percent 

Cumulative 

Percent 

Army 

530 

26.9% 

27% 

Navy 

212 

10.8% 

37.8% 

Air  Force 

554 

28.2% 

66.1% 

Marines 

20 

1% 

67.1% 

Coast  Guard 

14 

.7% 

67.8% 

DoD  Staff/Agency 

286 

14.5% 

82.4% 

Academic 

Community 

26 

1.3% 

83.7% 

Congress 

53 

2.7% 

86.4% 

Congressional 

Support 

10 

.5% 

86.9%% 

Non-Academic 

Research 

59 

3% 

89.9% 

Other 

198 

10.1% 

100% 

No  Response  to 
this  item 

5 

.3% 

not  included 

Column  Total  & 
Percent 

1967 

100% 

100% 

researchers  must  be  careful  to  take  this  bias  into  account  when  designing  the  survey 
distribution  scheme. 

With  respect  to  recipients'  jobs  (Question  4),  individuals  holding  jobs  described  as 
Manager  (30.9%,  n  =  602)  and  Action  Officer  (29.5%,  n  =  576)  were  most  likely  to 
receive  the  Supplement.  See  Table  IV-3  for  a  frequency  of  jobs  for  Supplement 
respondents.  Analysis  of  the  rank/grade  or  equivalent  non-Government  level  associated 
with  these  jobs  (Question  5)  indicated  that  most  respondents  to  the  Supplement  items  were 
in  Officer  grades  04-06  (44.7%,  n  =  879)  or  levels  GS/GM13-GS/GM15  (18.2%, 
n  =  358).  Table  IV -4  provides  a  frequency  distribution  by  rank/grade  for  all  Supplement 
readers. 

B.  DISTRIBUTION  OF  SUPPLEMENT 

In  this  section  the  frequency  with  which  respondents  receive  Supplement  (Question 
27)  is  cross-tabulated  with  the  three  demographic  variables  of  Employer  (Question  2),  Job 
(Question  4),  and  Rank/Grade  (Question  5),  which  were  analyzed  above. 

1 .  Supplement  Distribution  by  Employer 

Nearly  half  of  the  Supplement  readers  report  receiving  the  publication  either  every 
day  or  more  than  once  per  week  (48.9%,  n  =  958)  across  all  employer  groups.  Those 
working  for  DoD  Staff/Agency  organizations  (32.2%,  n  =  92)  and  the  Army  (29.6%, 
n  =  157)  were  the  two  groups  with  the  highest  reported  rate  of  daily  receipt.  See 
Table  IV-5  for  a  complete  breakdown  of  employer  (Question  2)  by  frequency  of  receipt 
(Question  27). 

Responses  to  Question  29  ("When  I  flnish  with  Supplement,  I  usually:")  indicated 
that  two-thirds  of  all  respondents  pass  the  publication  on  to  others  (68.8%,  n  =  1,243) 
across  all  employer  groups,  with  those  from  the  Matiues  (78.9%,  n  =  15)  and  the 
Air  Force  (75.6%,  n  =  393)  providing  the  highest  rates  and  members  of  Congress 
providing  the  lowest  rates  of  "pass  alongs."  See  Table  IV-6  for  an  analysis  of  Question  29 
by  all  Employer  groups. 

2 .  Supplement  Distribution  by  Job 

When  considering  the  frequency  of  Supplement  receipt  by  Job  (Question  4),  those 
described  as  Clerical/ Administrative  personnel  repon  the  highest  rate  of  daily  receipt 


Table  IV-3.  Frequency  of  Responses  to  Question  4: 
"My  job  can  be  best  described  as:"  (Job) 
Supplement  Readers  Only 


Job 

Frequency 

Percent 

Cumulative 

Percent 

Policy  Maker 

203 

10.3% 

10.4% 

Manager 

602 

30.9% 

41.3% 

1  Action  Officer 

576 

29.5% 

70.8% 

1  Scholar/Anaiyst 

193 

9.9% 

80.7% 

Clericai/Admini- 

strative 

155 

7.9% 

88.6% 

Technical 

79 

4% 

92.7% 

Non-Government 

Management 

13 

.7% 

93.3% 

Other 

130 

6.6% 

100% 

No  response  to 

1  this  item 

16 

.8% 

not  included 

Column  Total  & 
Percent 

1967 

100% 

100% 

IV-5 
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Table  IV-4.  Frequency  of  Responses  to  Question  5: 
"My  rank/grade  is:"  (Rank/Grade) 
Supplement  Readers  Only 


Rank/Grade 

Frequency 

Percent 

Cumulative 

Percent 

E1-E6 

74 

3.8% 

3.8% 

E7-E9 

65 

3.3% 

7.1% 

W1-W4 

5 

.3% 

7.4% 

01-03 

87 

4.4% 

11.8% 

04-06 

879 

44.7% 

56.7% 

07  and  above 

64 

3.3% 

60% 

GS1-GS7 

61 

3.1% 

63.1% 

GS8-GS12 

111 

5.6% 

58.8% 

GS/GM13- 

GS/GM15 

358 

18.2% 

87.1% 

SES  GS16-GS16 

82 

4.2% 

91.3% 

Jr  Professional 

17 

.9% 

92.2% 

Mid-level 

Professional 

55 

2.8% 

95% 

Sr  Professional 

85 

4.3% 

99.3% 

Clerk/Support 

2 

.1% 

99.4% 

Other 

11 

.6% 

100% 

No  response  to 
this  item 

11 

.6% 

not  included 

Column  Total  & 
Percent 


1967 


100% 


100% 


Table  IV-5.  Responses  to  Question  27:  "I  usually  receive  Current  News  Supplement: 

by  Employer 
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Table  IV-6.  Responses  to  Question  29:  "When  I  finish  with  the  Supplement,  I  usually: 

by  Employer 
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Column  TolU  A  Avorag*  1243  103  330 

Poroeni  Aoom  68.8%  10.7%  18.7% 


(45.8%,  n  =  71),  and  Policy  Makers  (34.5%,  n  =  70),  the  second  most  frequent.  The 
highest  percentages  of  those  who  report  getting  Supplement  rarely  are  Action  Officers 
(23.8%,  n  =  137)  and  "Others"  (23.8%,  n  =  31).  Table  IV-7  provides  a  complete 
distribution  of  Job  (Question  4)  by  frequency  of  receipt  (Question  27). 

Those  respondents  holding  jobs  of  Manager  (79%,  n  =  436)  and  Policy  Maker 
(68.1%,  n  =  128)  were  the  most  likely  to  pass  Supplement  on  to  others,  with  68.8% 
(n  =  1,237)  of  all  respondents  to  these  two  items  (Question  29  and  Question  4)  indicating 
this  response.  Non-Government  Managers  are  the  most  likely  to  discard  the  Supplement 
(38.5%,  n  =  24).  Table  IV-8  provides  an  analysis  of  the  frequency  of  responses  to  these 
two  items. 

3 .  Supplement  Distribution  by  Rank/Grade 

Examination  of  the  responses  to  Question  27  by  the  rank/grade  (Question  5)  of 
respondents  indicated  that  military  personnel  in  the  ranks  of  E1-E6  report  the  highest  rate  of 
daily  receipt  (48.6%,  n  =  36),  with  SES  GS16-GS18  level  civilians  the  second  most 
frequent  recipients  (46.3%,  n  =  38).  The  least  frequent  recipients  with  a  reliable  number  of 
responses  are  E7-E9  (26.2%,  n  =  17  report  receiving  Supplement  rarely).  Table  IV-9 
details  the  frequency  of  receipt  (Question  27)  by  all  rank/grades  (Question  5). 

When  examining  Question  29  by  rank/grade,  68.9%  (n  =  1,242)  of  all  rank/grades 
indicated  that  they  share  their  Supplement  with  others.  Civilians  in  grades  of  GS1-GS7 
(80.4%,  n  =  45)  and  Officers  in  ranks  of  04-06  (74%,  n  =  594)  provided  the  highest  "pass 
along"  rates  while  Mid-level  Professionals  report  the  lowest  (50%,  n  =  27)  with  any 
reliability.  A  complete  breakdown  of  responses  to  these  items  is  provided  in  Table  IV- 10. 

C.  RESPONSES  TO  SUPPLEMENT  CONTENT  ITEMS 

The  responses  to  survey  items  concerning  the  content  of  Supplement  have 
been  examined  and  then  cross-tabulated  with  the  three  demographic  items  of  Employer 
(Question  2),  Job  (Question  4),  and  Grade/Rank  (Question  5)  in  order  to  show  the 
distribution  of  responses. 

1 .  Content  by  Employer 

Table  IV- 1 1  presents  the  frequencies  and  percentages  of  responses  to  Question  28, 
which  addressed  the  amount  of  Supplement  usually  read  cross-tabulated  by  Employer. 


Table  IV*7.  Responses  to  Question  27:  ”1  usually  receive  Supplement:' 

by  Job 
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Table  IV-8.  Responses  to  Question  29:  "When  I  finish  with  the  Supplement,  I  usually: 

by  Job 


IV- 11 


Table  IV-9.  Respondents  to  Question  27:  "I  usually  receive 
Current  News  Supplement:"  by  Rank/Grade 


Rank/ 

Grada 

Queation  27 

Every 

working  day 

More  than 
once  a 
week 

Onoe  a 
week 

Twice  a 
month 

Once  a 
month 

Rarely 

Row  Total 

A  Percent 

E1-E6 

36 

16 

8 

2 

1 

11 

74 

46.6% 

21.6% 

10.8% 

2.7% 

1.4% 

14.9% 

3.8% 

E7-E9 

20 

19 

6 

2 

1 

17 

65 

30.8% 

29.2% 

9.2% 

3.1% 

1.5% 

26.2% 

3.3% 

W1-W4 

1 

1 

0 

0 

MM 

3 

5 

20% 

20% 

0% 

0% 

■EH 

60% 

.3% 

01-03 

17 

18 

21 

5 

19 

87 

19.5% 

20.7% 

24.1% 

5.7% 

21.8% 

4.4% 

04-06 

222 

223 

125 

66 

40 

203 

879 

25.3% 

25.4% 

14.2% 

7.5% 

4.7% 

23.1% 

44.9% 

07  A  above 

23 

17 

10 

3 

2 

9 

64 

35.9% 

26.6% 

15.6% 

4.7% 

3.1% 

14.1% 

14.1% 

GS1-GS7 

22 

10 

13 

2 

3 

11 

61 

36.1% 

16.4% 

21.3% 

3.3% 

4.9% 

18% 

3.1% 

GS8-GS12 

40 

19 

16 

5 

7 

24 

111 

36% 

17.1% 

14.4% 

4.5% 

6.3% 

21.6% 

5.7% 

GS/QM13- 

72 

75 

67 

49 

17 

78 

356 

GS/GM1S 

20.1% 

20.9% 

18.7% 

13.7% 

4.7% 

21.8% 

18.3% 

SES  GS16- 

38 

15 

10 

4 

WKM 

15 

82 

GS18 

46.3% 

18.3% 

1Z2% 

4.9% 

18.3% 

4.2% 

Jr  Proles- 

2 

2 

2 

5 

2 

4 

17 

sional 

11.8% 

11.8% 

11.8% 

2P4% 

11.8% 

23.5% 

.9% 

Mid-«avo( 

9 

4 

14 

12 

9 

7 

55 

Protea- 

Bional 

16.4% 

7.4% 

25.5% 

21.6% 

16.4% 

1i7% 

2.8% 

Sf  Profea- 

12 

16 

24 

14 

6 

13 

85 

sional 

14.1% 

18.8% 

28.2% 

16.5% 

7.1% 

15.3% 

4.3% 

ClortV 

0 

1 

1 

WBM 

0 

2 

Support 

0% 

50% 

50% 

0% 

.1% 

Olhar 

4 

1 

1 

2 

3 

MM 

11 

36.4% 

9.1% 

9.1% 

18.2% 

27.3% 

.6% 

Column 
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437 

317 

174 

96 

414 

1956 

Total « 
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4.9% 

21.2% 

100% 
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Table  lv-10.  Respondents  to  Question  29:  "When  I  finish  with  the 
Supplement,  i  usually:”  by  Rank/Grade 


Rank/Grad* 

Quaation  20 

Pass  it  on  to 
others 

Keep  it  on  file 

Discafdit 

Othar 

Row  Total  6 
Peicant 

E1-E6 

42 

11 

17 

1 

71 

59.2% 

15.5% 

23.9% 

1.4% 

3.9% 

E7-ES 

44 

4 

11 

1 

60 

73.3% 

6.7% 

18.3% 

1.7% 

3.3% 

W1-W4 

2 

0 

1 

0 

3 

66.7% 

0% 

33.3% 

0% 

.2% 

01-03 

52 

7 

17 

0 

76 

68.4% 

9.2% 

22.4% 

0% 

4.2% 

044)6 

504 

63 

136 

10 

803 

74% 

7.8% 

16.0% 

1.2% 

44.6% 

07  6  abova 

40 

8 

12 

0 

60 

66.7% 

13.3% 

20% 

0% 

3.3% 

OS1-QS7 

45 

4 

6 

1 

56 

80.4% 

7.1% 

10.7% 

1.8% 

3.1% 

GS8-GS12 

67 

17 

17 

1 

102 

65.7% 

16.7% 

16.7% 

1% 

5.7% 

GS/GM13- 

231 

25 

68 

0 

333 

GS/QM15 

60.4% 

7.5% 

20.4% 

2.7% 

18.8% 

SES  GS16-GS18 

44 

6 

24 

2 

76 

57.9% 

7.9% 

31.6% 

2.6% 

4.2% 

Jr  Profataional 

6 

6 

5 

0 

17 

35.3% 

35.3% 

20.4% 

0% 

.0% 

MU-laval 

27 

15 

0 

3 

54 

Proiatatonal 

50% 

27.8% 

16.7% 

5.6% 

3% 

Sr  Proiaaaional 

43 

24 

10 

3 

80 

53.8% 

30% 

1^5% 

3.8% 

4.4% 

C)ai1(/S«jppart 

0 

1 

0 

0 

1 

0% 

100% 

0% 

0% 

.1% 

Ottwr 

5 
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3 
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50% 

20% 

30% 

0% 

.6% 
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Table  IV’11.  Responses  to  Question  28:  "Of  the  articles  in  Supplement,  I  usually  read:* 

by  Employer 
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Over  half  (52.1%,  n  =  942)  of  all  respondents  to  these  two  items  (Questions  2  and  28)  read 
half  or  more  of  the  Supplement.  Of  those  respondents  reporting  reliable  frequencies.  Army 
personnel  (57.3%,  n  =  275)  and  the  Academic  Community  (75%,  n  =  18)  reported  the 
highest  percentages. 

Survey  question  33A  asked  respondents  to  rate  the  ability  of  Supplement  to  help 
them  set  their  daily  agenda.  Only  10%  of  these  respondents  either  agreed  or  strongly 
agreed  with  this  item  (10.2%,  n  =  178)  across  employers.  Responses  to  item  33B 
indicates  that  Supplement  does  a  better  job  at  helping  readers  gather  the  information  they 
need  to  do  their  jobs  well.  Across  all  employer  groups  48.4%  (n  =  843)  reported 
agreement  or  strong  agreement.  Those  in  non-military  organizations  rated  Supplement's 
information  content  substantially  higher  than  those  from  military  organizations,  with 
respondents  from  Non-Academic  Research  organizations  (87.5%,  n  =  49)  and  the 
Academic  Community  (85.5%,  n  =  18)  providing  much  higher  ratings  than  the  Navy 
(42.3%,  n  =  74)  or  Army  (42%,  n  =  196).  These  aie  the  lowest  ratings  with  reliable 
frequencies.  Nearly  half  of  the  respondents  to  Question  33C  indicated  that  Supplement 
also  helps  them  understand  the  effect  of  their  decisions  and  actions  on  public  opinion 
(45.5%,  n  =  786)  across  all  employers.  The  frequency  of  responses  for  each  employer 
group  to  these  three  items  are  presented  in  Table  IV- 12. 

Responses  to  Question  34  provided  an  overall  usefulness  rating  for  Supplement  and 
indicated  that  79.1%  (n  =  1,398)  of  respondents  either  agreed  or  strongly  agreed  that 
Supplement  is  a  useful  publication  across  ail  employers.  Of  those  providing  reliable 
frequencies,  DoD  Staff/Agency  personnel  provided  the  most  enthusiastic  ratings  (81.4%, 
n  =  211).  Table  IV- 13  provides  the  frequency  breakdown  of  the  usefulness  ratings  by 
Employer. 

2.  Content  by  Job 

When  Question  28  was  cross-tabulated  by  Job  (Question  4),  52.1%  (n  =  936)  again 
read  half  or  more  of  Supplement  across  all  response  categories.  Those  described  as  Policy 
Makers  (56.6%,  n  =  108)  provided  the  highest  ratings.  Table  IV- 14  provides  a  frequency 
breakdown  of  responses  to  these  two  items. 

Table  IV- 15  presents  responses  to  survey  questions  33A-33C.  Question  33A  asked 
respondents  to  rate  the  ability  of  Supplement  to  help  them  set  their  daily  agenda.  Again, 
few  respondents  either  agreed  or  strongly  agreed  with  this  item  (10.3%,  n  =  178)  across 


Table  IV-12.  Respondents  Who  Agreed  or  Strongly  Agreed  to  Questions 
33A-33C:  "The  Supplement  helps  me  to:"  by  Employer 


Employer 

Q33A 

Q33B 

Q33C 

Set  my  daily  agenda 

Gather  the  information 

Understand  the  effect 

1  need  to  do  my  job 

of  my 

weil 

decisions/actions  on 

pubiic  opinion 

• 

Army 

42 

196 

215 

9% 

42% 

46.4% 

Navy 

15 

74 

82 

8.6% 

42.3% 

46.9% 

Air  Force 

32 

192 

199 

• 

6.4% 

38.6% 

40.2% 

Marines 

1 

7 

8 

5.6% 

36.8% 

42.1% 

Coast  Guard 

0 

4 

3 

0% 

40% 

30% 

• 

OoO  Staff/Agency 

20 

131 

123 

7.8% 

51.5% 

48.1% 

Academic  Community 

4 

18 

9 

19.1% 

85.5% 

42.9% 

Congress 

4 

35 

19 

• 

8.4% 

74.5% 

40.4% 

Congressional 

0 

6 

5 

Support 

0% 

60% 

50% 

Non-Academic 

2 

49 

20 

Research 

3.6% 

875% 

375% 

• 

Other 

58 

130 

103 

32.4% 

71% 

582% 

Column  Total  & 

178 

843 

786 

Average  Percent 

102% 

48.4% 

455% 

Across  Employers 

• 
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Table  IV-13.  Respondents  Who  Agreed  or  Strongly  Agreed  to  Question  34: 
"Overall,  I  find  the  Supplement  a  useful  publication"  by  Employer 


Employer 

Question  34 

Army 

384 

80.6% 

Navy 

CO  -4 

Air  Force 

358 

71.2% 

Marines 

16 

84.3% 

Coast  Guard 

6 

60% 

DoD  Staff/Agency 

211  1 

81.4%  I 

Academic  Community 

22  1 

100%  1 

Congress 

38 

79.1% 

Congressional  Support 

8 

80% 

Non-Academic  Research 

56 

96.6% 

Other 

157 

86.3%  1 

j  Column  Total  &  Average  Percent  Across 

1398 

j  Employers 

79.1%  1 

I 


I 
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Table  IV>14.  Responses  to  Question  28:  "Of  the  articles  in  Supplement,  I  usually  read:"  by  Job 


r" 

r" 

r 

r 

• 

Row  Total 
Percent  c 
Each  Jot 

191 

10.6% 

553 

30.8% 

523 

29.1% 

183 

10.2% 

141 

7.8% 

76 

4.2% 

13 

.7% 

118 

6.6% 

1798 

100% 

Headtines  only 

14 

7.3% 

46 

8.3% 

39 

7.5% 

8 

4.4% 

22 

15.6% 

3 

3.9% 

o  g 

6 

5.1% 

138 

7.7% 

• 

s 

• 

1 

w 

O 

1 

30 

15.7% 

81 

14.6% 

91 

17.4% 

25 

13.7% 

24 

17% 

15 

19.7% 

2 

15.4% 

19 

16.1% 

287 

16% 

e 

o 

1 

1 

c 

1 

i 

39 

20.4% 

141 

25.5% 

135 

25.8% 

55 

30.1% 

17 

12.1% 

16 

21.1% 

2 

15.4% 

32 

27.1% 

437 

24.3% 

• 

3 

O 

2 

? 

k 

34 

17.8% 

105 

19% 

126 

24.1% 

46 

25.1% 

CM 

17 

22.4% 

5 

38.5% 

21 

17.8% 

384 

21.4% 

• 

1 

c 

i 

S 

45 

23.6% 

125 

22.6% 

fs: 

33 

18% 

25 

17.7% 

20 

26.3% 

4 

30.8% 

23 

19.5% 

367 

20.4% 

• 

a 

• 

29 

15.2% 

55 

9.9% 

40 

7.6% 

16 

8.7% 

23 

16.3% 

5 

6.6% 

og 

17 

14.4% 

185 

10.3% 

Policy  Maker 

Manager 

Action  Officer 

1  Scholar/Anaiy 

L?l__ _ 

Clerical/ 

Administrative 

Technical 

Non- 

Qovemmenl 

ManagemetS 

Other 

Column  Total 
&  Average 
Percent 

Across  Jobs 

• 
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Table  IV-1S.  Respondents  Who  Agreed  or  Strongly  Agreed  to  Questions  33A-33C: 

"The  Supplement  helps  me  to:”  by  Job 


I 


' 

Understand  the  effect  of  my  | 
decisions/actions  on  public  1 

opinion  g 

98  1 

53.3%  V 

247 

46.5% 

76 

44.4% 

47 

35.6% 

36 

51.4% 

I  %09 

_ T _ 

44  1 

39.3%  1 

1390 

79.2% 

Q33B 

Gather  the  Information  1  need  to 
do  my  job  well 

97 

52.7% 

272 

51% 

201 

39.6% 

124 

71.2% 

32 

25.8% 

31 

44.3% 

10 

90.9% 

65 

55.5% 

834 

48.3% 

Q33A 

Set  my  daily  agenda 

»  S' 
«  S 
00 

76 

14.3% 

CM  5* 
« 

16 

10.6% 

18 

13.6% 

7 

100% 

0 

0% 

^  *r> 
o> 

178 

10.3% 

L 

Policy  Maker 

Manager 

Action  Officer 

Scholar/Anafyst 

Clerical/Adminisirative 

Technical 

Nort-Govemmeni  Management 

Other 

Cotunwi  Total  &  Average 

Percent  Across  Jobs 
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jobs.  Item  33B  indicated  that  Supplement  does  a  better  job  at  helping  readers  gather  the 
information  they  need  to  do  their  jobs  well  (48.3%,  n  =  834)  across  all  jobs.  However, 
better  than  three  quarters  of  the  respondents  to  (Question  33C  agreed  or  agreed  strongly  that 
Supplement  helps  them  understand  the  effect  of  their  decisions  and  actions  on  public 
opinion  (79.2%,  n  =  1,390)  across  all  jobs. 

Table  IV-16  presents  responses  to  Question  34  which  provided  an  overall 
usefulness  rating  of  Supplement.  These  responses  indicated  that  79.2%  (n  =  1,390)  of 
respondents  either  agreed  or  strongly  agreed  that  Supplement  is  a  useful  publication  across 
all  jobs  with  Scholars/ Analysts  finding  it  most  useful  (89.8%,  n  =  159). 

3.  Content  by  Rank/Grade 

Across  all  ranks/grades  (Question  5),  more  than  half  of  the  respondents  (52.3%, 
n  =  942)  again  read  at  least  half  of  Supplement.  Those  in  officer  ranks  of  07  and  above 
(64.9%,  n  =  39)  and  civilian  grades  of  GS8-GS12  (65.7%,  n  as  67)  provided  the  highest 
ratings.  Table  IV-17  lists  the  complete  frequency  of  responses  to  these  two  items. 

Survey  question  33A  asked  respondents  to  rate  the  ability  of  Supplement  to  help 
them  set  their  daily  agenda.  Again,  only  10%  either  agreed  or  strongly  agreed  with  this 
item  (10.4%,  n  =  179)  across  ranks/grades.  Responses  to  item  33B  indicated  that 
Supplement  helps  readers  gather  the  information  they  need  to  do  their  jobs  well  (48.5%, 
n  =  830)  across  all  ranks/grades.  Nearly  half  of  the  respondents  indicated  that  Supplement 
also  helps  them  understand  the  effect  of  their  decisions  and  actions  on  public  opinion 
(45.4%,  n  =  774)  across  all  ranks/grades.  The  frequency  of  responses  for  each  job  group 
to  these  three  items  are  presented  in  Table  IV-18. 

(^estion  34  provided  an  overall  usefulness  rating  of  Supplement  and  indicated  that 
79.3%  (n  =  1,396)  of  these  respondents  either  agreed  or  strongly  agreed  that  Supplement  is 
a  useful  publication  across  all  ranks/grades  with  Senior  Professionals  being  the  most 
enthusiastic  (94.9%,  n  =  73).  Table  IV- 19  provides  the  frequency  analysis  of  this 
usefulness  rating  by  rank/grade. 

A  discussion  of  these  results  and  the  conclusions  and  recommendations  to  be  drawn 
from  them  are  contained  in  the  next  chapter.  Detailed  analyses  of  response  firequencies  for 
each  survey  question  are  presented  in  the  Appendixes. 
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Table  IV*16.  Respondents  Who  Agreed  or  Strongly  Agreed  to  Question  34: 
"Overall,  I  find  the  Supplement  a  useful  publication"  by  Job 


Table  IV-17.  Respondents  to  Question  28:  "Of  the  articles  in  Supplement, 

I  usually  read:"  by  Rank/Grade 


Rank/Grade 

Question  28 

All 

Mora  than 
half 

About  half 

Lass  than 
hall 

Onaorbvo 

Only  the 
headlines 

Row  Total 

8  Percent 

E1-E6 

12 

14 

15 

12 

7 

10 

70 

17.1% 

20% 

21.4% 

17.1% 

10% 

14.3% 

3.9% 

E7-E9 

10 

IS 

0 

12 

7 

6 

59 

16.0% 

25.4% 

15.3% 

20.3% 

11.0% 

10.2% 

3.3% 

W1-W4 

0 

1 

0 

1 

0 

2 

4 

0% 

25% 

0% 

25% 

0% 

50% 

.2% 

01-03 

2 

12 

23 

10 

11 

0 

76 

2.6% 

15.8% 

30.3% 

25% 

14.5% 

11.8% 

4.2% 

04-06 

86 

174 

ISO 

104 

129 

65 

807 

10.7% 

21.6% 

10.7% 

24% 

16% 

8.1% 

44.8% 

07  6  abova 

8 

17 

14 

11 

10 

0 

60 

13.3% 

28.3% 

23.3% 

18.3% 

16.7% 

0% 

3.3% 

GS1-QS7 

8 

0 

IS 

0 

8 

8 

57 

14% 

15.8% 

26.3% 

15.8% 

14% 

14% 

3.2% 

QSS-GS12 

IS 

20 

32 

8 

20 

7 

102 

14.7% 

10.6% 

31.4% 

7.8% 

10.6% 

6.0% 

5.7% 

6S/GM13- 

28 

63 

68 

94 

52 

23 

328 

GS/GM15 

8.5% 

10.2% 

20.7% 

28.7% 

15.9% 

7% 

18.2% 

SES  GS16- 

7 

11 

14 

21 

14 

8 

75 

GS18 

0.3% 

14.7% 

18.7 

28% 

18.7% 

10.7% 

4.2% 

Jr  Profaa- 

3 

3 

4 

5 

2 

■EH 

17 

tional 

17.6% 

17.6% 

23.5% 

20.4% 

11.8% 

.9% 

Mid-taval 

0 

11 

8 

22 

13 

0 

54 

Protaa- 

tienal 

0% 

20.4% 

14.8% 

40.7% 

24.1% 

0% 

3% 

Sr  Profaa- 

7 

17 

20 

22 

14 

1 

■H 

sional 

8.6% 

21% 

24.7% 

27.7% 

17.3% 

1.2% 

■Em 

OmU 

1 

0 

■■ 

WBM 

■OH 

■EH 

1 

Support 

100% 

0% 

HSil 

■bH 

.1% 

Olhar 

0 

4 

3 

4 

0 

■H 

11 

0% 

36.4% 

27.3% 

36.4% 

0% 

■H 

.8% 

Column 

187 

371 

384 

434 

287 

130 

1802 

Toiiy& 

Pcfcsnt 

10.4% 

20.6% 

21.3% 

24.1% 

15.0% 

7.7% 

100% 

Table  IV-18.  Respondents  Who  Agreed  or  Strongly  Agreed  to  Questions 
33A-33C:  "The  Supplement  helps  me  to:"  by  Rank/Grade 


RanK/Grade 

Question  33A 

Question  33B 

Question  33C 

Set  my  daily  agenda 

Gather  the  infomation  1 
need  to  do  my  job  well 

Understand  the  effect  of  my 
decisions/actions  on  public 
opinion 

E1-E6 

11 

19 

27 

15.5% 

26.8% 

38.1% 

E7-E9 

6 

16 

20 

10.3% 

31.6% 

35.1% 

W1-W4 

0 

0 

0 

0% 

0% 

0% 

01-03 

5 

36 

34 

6.5% 

46.8% 

44.2% 

04-06 

03 

355 

37< 

11.9% 

45.6% 

47.7% 

07  6abava 

6 

34 

34 

10.7% 

58.6% 

60.8% 

GS1-GS7 

6 

14 

24 

11.3% 

26.5% 

45.2% 

GS8-OS12 

8 

43 

38 

6.6% 

45.3% 

40.0% 

QS/GM13-GS/GM1S 

10 

147 

133 

6% 

46.7% 

4^2% 

SES  GS16-GS18 

9 

47 

36 

1i7% 

64.4% 

50% 

Jr  Protaaaional 

1 

11 

6 

6.3% 

66.8% 

37.5% 

Md-taval  Profaasional 

3 

43 

16 

5.8% 

78.9% 

32% 

Sr  Profaaaional 

10 

64 

41 

13.7% 

85.3% 

56.1% 

Clark/Support 

1 

1 

1 

100% 

100% 

100% 

Ottwr 

1 

10 

3 

9.1% 

00.9% 

27.3% 

Colmnn  Total  6  Aveng* 

179 

830 

774 

Percent 

10.4% 

48.5% 

45.4% 
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Table  IV-19.  Respondents  Who  Agreed  or  Strongly  Agreed  to  Question  34: 
"Overall,  I  find  the  Supplement  a  useful  publication"  by  Rank/Grade 


Rank/Grade 

Question  34 

E1-E6 

57 

78.7% 

E7-E9 

43 

71.6% 

W1-W4 

1 

33.3% 

01-03 

57 

75% 

04-06 

609 

77.8% 

07  &  above 

52 

89.7% 

GS1-GS7 

43 

76.4% 

QS8-GS12 

75 

74.3% 

GS/GM13-GS/GM15 

250 

78.2% 

SES  GS16-GS18 

62 

84.9% 

Jr  Professional 

16 

94.2% 

Mid-level  Professional 

47 

88.6% 

Sr  Professional 

73 

94.9% 

Clerk/Support 

1 

100% 

Other 

11 

100% 

Column  Total  &  Average  Percent 

1396 

79.3% 
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V.  CONCLUSIONS  AND  RECOMMENDATIONS 


Developing  a  methodology  for  this  survey  was  more  challenging  than  usual  because 
the  goal  was  to  measure  the  size,  composition,  and  opinions  of  an  audience  we  knew 
nothing  about.  Given  the  undefined  characteristics  of  the  total  audience,  every  effort  was 
made  to  capture  information  from  as  many  potential  readers  as  possible  in  order  to  establish 
an  initial  basis  for  describing  the  population.  The  use  of  saturation  techniques  for  survey 
distribution  resulted  in  a  total  of  3,800  valid  responses.  Given  the  anonymity  of  this 
population  prior  to  this  effort  and  subsequent  difficulty  in  survey  distribution,  the  rate  of 
response  (approximately  25%)  is  considered  favorable.  While  the  survey  distribution 
techniques  of  the  present  effort  were  exploratory  in  nature,  the  method  of  sending 
significantly  more  surveys  than  the  number  of  known  first-hand  readers  successfully 
allowed  individuals  who  receive  copies  of  Early  Bird  (EB)  indirectly  to  be  represented. 
This  saturation  technique,  coupled  with  responses  to  questions  concerning  mode  of  receipt 
and  mode  of  disposition  after  reading  the  publications,  allowed  us  to  analyze  the  random 
sample  of  responses  we  received  to  estimate  the  character  of  the  shadow  audience. 

The  results  obtained  and  conclusions  offered  regarding  this  sample  of 
EB/Supplement  readers  provide  a  better  understanding  of  the  informal  distribution  modes 
most  commonly  employed  and  may  serve  as  a  basis  for  guiding  future  research  of  this 
audience.  With  the  estimates  of  audience  size  and  other  lessons  learned  from  this  initial 
survey  effort,  alternate  methods  of  EB/Suppiement  distribution  can  be  explored  and  other 
more  sophisticated  approaches  to  sampling  the  direct  and  indirect  populations  of  readers 
can  be  developed.  Future  investigations  could  be  accomplished  by  distributing  a 
preliminary  survey  instrument  included  as  a  tear  out  page  of  a  particular  issue  of  EB  and 
Supplement.  In  future  studies  this  simple  response  form  could  ask  the  respondent  who  he 
is,  where  he  got  his  copy,  what  he  does  with  it,  whom  he  gives  it  to,  and  whether  or  not  he 
makes  additional  copies.  The  resulting  information  could  be  used  to  characterize  the 
audience  that  exists  beyond  the  official  mailing  lists  in  order  to  validate  the  first  estimate 
obtained  by  the  present  approach.  Since  the  existence  of  the  shadow  audience  has  now 
been  verified,  we  recommend  including  at  least  five  survey  instruments  per  issue  so  that 
more  of  these  readers  may  participate. 


A.  CONCLUSIONS  REGARDING  EARLY  BIRD 

Overall,  the  most  widely  represented  groups  who  responded  to  this  survey  were 
officers  in  the  ranks  04-06  from  the  Army  and  Air  Force.  The  largest  civilian  group  of 
respondents  were  among  grades  GS/GM13-GS/GM15.  The  most  frequently  reported 
positions  were  from  those  described  as  Managers  and  Action  Officers. 

1 .  Size  of  the  Shadow  Audience 

By  examining  the  methods  by  which  individuals  report  receiving  their  EB,  the  total 
EB  audience  (direct  and  indirect)  was  estimated  conservatively  to  be  15,213  readers.  This 
estimate  is  based  directly  on  the  number  of  readers  who  report  receiving  EB  from  a  source 
other  than  one  of  the  three  formal  CNARS  channels  of  distribution.  The  results  of  this 
survey  provide  the  first  empirical  evidence  of  the  existence  and  estimated  size  of  this 
"shadow"  audience. 

2 .  Assessment  of  EB  Effectiveness 

The  responses  to  survey  items  assessing  the  content  of  EB  indicated  that  overall  the 
vast  majority  of  respondents  are  using  EB  and  view  the  publication  very  positively.  Most 
individuals  reponed  that  they  read  half  or  more  of  EB  and  find  articles  on  DoD 
Organization  and  Budget  and  International  Security  Issues  the  most  valuable.  Most 
respondents  also  found  EB  relevant  to  their  duties  and  considered  it  a  contribution  to  their 
knowledge  of  DoD  policies,  programs,  and  activities.  The  majority  of  respondents  also  felt 
that  EB  informed  them  of  the  results  of  DoD  policy  decisions.  In  addition,  many 
individuals  indicated  that  EB  is  an  effective  aid  in  decision-making,  especially  in  Public 
Affairs/Legislative  issues.  Most  readers  also  agreed  that  the  publication  provides 
information  that  assists  them  in  performing  their  jobs  and  in  understanding  the  effects  of 
their  actions  on  public  opinion. 

3.  Demographics  of  the  Sample 

Most  EB  readers  are  Army  and  Navy  personnel  and  civilians  working  in  Non- 
Academic  Research  organizations  in  the  job  categories  of  Manager  or  Action  Officer  at  the 
rank/grade  of  ()4-06/GS13-15.  They  usually  receive  an  original  copy  of  EB;  however,  they 
receive  it  most  often  through  inter-office  mail.  When  they  finish  with  EB  they  most  often 
pass  it  on,  usually  by  personally  handing  it  to  a  colleague. 
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4 .  Distribution  of  EB  Across  the  Sample 

Even  though  the  majority  of  respondents  receive  an  original  ("yellow  copy")  of  EB, 
they  are  not  necessarily  direct  recipients  of  the  publication.  Results  showed  that  most 
people  receive  their  copy  of  EB  through  indirect  methods  of  distribution,  such  as  inter¬ 
office  mail,  rather  than  through  one  of  the  three  formal  distribution  channels  employed  by 
the  CNARS  staff.  This  implies  that  a  significant  proportion  of  readers  are  sharing  their 
copies.  This  implication  is  further  supported  by  the  fact  that  most  respondents  repon 
passing  their  EB  on  to  others,  usually  to  a  colleague,  when  they  have  finished  reading  it. 
Those  working  in  Non- Academic  Research  organizations  are  most  likely  to  get  an  original 
copy  of  EB  while  those  in  the  Coast  Guard  are  least  likely  to  get  a  "yellow  bird." 

B.  CONCLUSIONS  REGARDING  THE  SUPPLEMENT 

1 .  Demographics 

Survey  items  pertaining  to  Supplement  indicated  that  1,967  of  the  total  3,800 
survey  respondents  report  reading  Supplement.  Although  this  number  is  three  times  the 
daily  production  run  of  650,  no  reliable  calculation  of  the  estimated  shadow  audience  was 
possible,  due  to  the  lack  of  information  regarding  the  mode  of  receipt.  Most  Supplement 
readers  are  Army  or  Air  Force  personnel  and  civilians  working  for  DoD  Staff/Agencies 
who  hold  jobs  as  Managers  and  Action  Officers  in  the  ranks  of  04-06  and  grades  of 
GS13-15. 

2 .  Distribution  of  Supplement 

Over  two  thirds  of  Supplement  readere  indicated  that  they  pass  the  publication  on  to 
others  after  reading  it,  thus  implying  that  a  shadow  audience  exists  for  Supplement  as  well 
as  EB.  Of  those  who  repon  reading  Supplement,  most  read  it  at  least  once  a  week,  with  a 
large  proponion  reading  it  more  frequently  than  once  per  week.  In  terms  of  how  much  of 
the  Supplement  they  read,  there  is  a  normal  distribution  with  the  highest  frequency  and 
percentage  associated  with  the  response  of  "less  than  half." 

3 .  Assessment  of  Supplement  Effectiveness 

In  terms  of  content,  over  three  quaners  of  Supplement  readers  view  the  publication 
as  generally  useful.  About  half  indicate  that  Supplement  provides  information  that  assists 


them  in  performing  their  jobs  and  in  understanding  the  effect  of  their  decisions  and  actions 
on  public  opinion. 

C.  RECOMMENDATIONS 

Based  on  the  conclusions  just  discussed,  recommendations  are  provided  below  to 
increase  the  effectiveness  of  these  publications  in  terms  of  distribution.  Following  these 
suggestions,  a  few  recommendations  are  offered  to  the  CNARS  staff  regarding  future 
survey  techniques  for  this  audience  in  order  to  ensure  that  EB  and  Supplement  remain 
useful  and  available  publications  for  the  DoD  community. 

1 .  Recommendations  to  Enhance  the  Effectiveness  of  EB  and 
EB  Supplement 

•  Save  money  by  encouraging  readers  to  share  EB  and  EB  Supplement  by  means 
other  than  duplication  via  periodic  reminders  in  the  publications,  since  readers 
are  already  inclined  in  this  direction. 

•  Employ  the  more  conservative  estimate  of  the  size  of  the  shadow  audience  if  a 
reduction  in  the  daily  press  run  is  being  considered. 

2 .  Recommendations  to  Increase  the  Reliability  and  Validity  of  Future 
CNARS  Surveys 

•  Explore  alternate  survey  distribution  methods,  such  as  multiple  tear-out 
surveys  within  the  publication. 

•  Future  survey  efforts  should  employ  alternate  channels,  such  as  inter-office 
mail,  to  distribute  the  survey,  as  this  was  the  most  frequently  reported  mode  of 
EB  distribution. 

•  Future  survey  research  regarding  Supplement  should  include  items  addressing 
the  distribution  channels  through  which  readers  receive  their  Supplement,  in 
order  to  establish  the  total  audience  size. 
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EARLY  BIRD/CURRENT  NEWS  SUPPLEMENT 
QUESTIONNAIRE 


SURVEY  OF  CURRENT  NEWS  ANALYSIS  AND  RESEARCH  SERVICE’S  (CNARS) 

EARLY  BIRD/CURRENT  NEWS  SUPPLEMENT  READERS _ 


If  you  are  an  Eariy  Bird  (EB)  or  Current  News  (CN)  Supplement  Reader,  please  complete  the  following  survey  in  ink.  The 
information  that  you  {vovide  will  help  us  better  understand  your  needs.  If  you  have  already  completed  this  survey  or  if  you  have 
never  seen  the  EB  or  CN  Supplement,  please  pass  this  questionnaire  on  to  an  EB  or  CN  Supplement  Reader.  Thank  you. 
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SURVEY  OF  CURRENT  NEWS  ANALYSIS  AND  RESEARCH  SERVICE’S  (CNARS) 
EARLY  BIRD/CURRENT  NEWS  SUPPLEMENT  READERS 


If  you  are  an  Early  Bird  (EB)  or  Current  News  (CN)  Siqjplennent  Reader,  please  complete  the  following  survey  in  ink.  The 
inf(»mation  that  you  provide  will  help  us  better  understand  your  needs.  If  you  have  already  completed  this  survey  or  if  you  have 
never  seen  the  EB  or  CN  Supplement,  please  pass  this  questionnaire  on  to  an  EB  or  CN  Supplement  Reader.  Thank  you. 
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COURIERS 


THE  CNARS  EARLY  BIRD 

SURVEY 

WILL  BE  CONDUCTED 
DURING  MARCH  1991 
BY  A  TEAM  OF 
CONTRACTORS 

PLEASE 

HELP  US  KEEP  YOU 
BETTER  INFORMED 


THANKS  FOR  YOUR  COOPERATION 


B-3 


Notice  of  4  March  1991 


EMILY  BIRD  READER  BDRTEY 

Given  recent  %forlcl  events,  news  regarding  Defense 
issues  has  never  been  nore  important.  Zn  an  effort  to 
provide  our  readers  with  the  best  possible  coverage,  the 
CURRENT  NEWS  Staff  is  seeking  your  impressions  of  Early 
Bird  and  Current  News  Supplement. 

Beginning  March  15,  1991,  we  will  distribute  a  brief 
survey  designed  to  get  information  to  better  serve  our 
readers . 

We  need  the  cooperation  of  all  Early  Bird  and 
Supplement  readers,  to  ensure  we  obtain  the  most  accurate 
and  complete  information  possible.  Please  look  for  your 
copy  of  the  survey  and  respond  quickly.  Your  support  for 
this  effort  will  help  guarantee  continued  improvement  in 
delivery  of  vital  of  DoD-related  news.  Thank  you. _ 


Notice  of  11  March  1991 


EARLY  BIRD  READER  SURVEY 

A  quick  reminder  that 
beginning  March  is,  1991,  we  will 
distribute  a  brief  survey  to  all 
Early  Bird  and  Current  News 
Supplement  readers.  This  survey 
will  help  us  better  define  the 
information  needs  of  the  Early  Bird 
and  current  News  Supplement 
audience . 

Given  recent  world  events, 
news  regarding  Defense  issues  has 
never  been  more  important.  Please 
help  us  Improve  our  ability  to  meet 
your  information  needs  by  quickly 
completing  and  returning  your  copy 
of  the  survey. 
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Survey  Instructions 


If  you  are  an  Early  Bird  or  Current  News  Supplement  reader,  please 
complete  the  following  survey.  The  information  you  provide  will 
help  us  better  understand  your  information  needs.  If  you  have 
already  completed  a  copy  of  this  survey,  or  if  you  have  never  seen 
the  Early  Bird  or  current  News  supplement,  please  pass  this 
questionnaire  on  to  an  Early  Bird  or  current  News  Supplement 
reader .  Thank  you . 


Notices  for  Placement  on  or  about  22  March  1991 


EARLY  BIRD  READER  SURVEY 

A  quick  lauinder  ditf  we  »e  cuncody  duuibminc 
■  brief  (unrey  to  all  Earfy  Bird  ud  Currtml  Nrwt 
Suppkmat  leaden.  Thi*  larvcy  will  help  ua  better  define 
the  nfonaMioa  needi  of  the  Eariy  Bird  ^  CurraU  Ntwr 
SuppitmtM  eiidimcr 

We  thank  diace  of  yva  who  have  already  completed 
and  mamad  a  queetkanain;  and  if  you  have  not  yet 
completed  a  copy  of  thia  survey  we  encouiaie  you  take  a 
few  momemi  sirf  respond.  Your  psilicipatan  trill  help  us 
hnpiove  our  ability  to  meet  your  infamiatica  needs. 


EARLY  BIRD  READER  SURVEY 

A  quick  reminder  that  we  are  cairently  distributing  a 
brief  survey  to  all  Earty  Bird  and  Cwrtia  News  Svpptement 
readers.  This  survey  wfll  help  us  better  define  the  infonnation 
needs  of  the  Earty  Bird  and  Curreiu  News  Supplement 
audience. 

We  thank  those  of  you  who  have  already  oonipieted  and 
retutned  a  questionnaire,  and  if  you  have  not  yet  ocmideied  a 
copy  of  this  suivey  we  enoourage  you  take  a  few  moments  and 
respond.  Your  paitidpaton  will  help  us  impiove  our  dbiliiy  to 
meet  your  infonnatiao  needs. 
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APPENDIX  C 


FREQUENCIES  OF  RESPONSES  TO 
QUESTIONS  3  AND  6 


[Any  difference  from  100%  in  the  total  of  the  Percent  column  is  due  to  rounding.] 


Frequency  of  Responses  to  Question  3: 
"The  mission  of  my  organization  is:” 


Mission 

Frequency 

Percent 

Cumulative 

Percent 

Policy  making 

878 

23.1% 

23.6% 

R&D 

253 

6.7% 

30.4% 

Operations 

390 

10.3% 

40.9% 

Intelligence 

271 

7.1% 

48.1% 

Public  or 

Legislative  Affairs 

321 

8.4% 

56.8% 

Budget  &  Finance 

175 

4.6% 

61.5% 

Acquisition 

143 

3.8% 

65.3% 

Human  Resources 

106 

2.8% 

68.1% 

Logistics/Support 

268 

7.1% 

75.3% 

Other 

918 

24.2% 

100% 

No  response  to 
this  item 

77 

2% 

not  included 

Column  Total  & 
Percent 

3800 

100% 

100% 
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Frequency  of  Responses  to  Question  6: 
"My  highest  level  of  education  Is:" 


Education 

Frequency 

Percent 

Cumulative 

Percent 

High  School  or 

GED 

89 

2.3% 

2.4% 

Some  college,  no 
degree 

339 

8.9% 

11.3% 

Associate's 

Degree 

105 

2.8% 

14.1% 

Bachelor’s  Degree 

746 

19.6% 

33.8% 

Master's  Degree 

2089 

55% 

89% 

Ph.D/Professional 

Degree 

416 

10.9% 

100% 

No  response  to 
this  item 

16 

.4% 

not  included 

Column  Total  & 
Percent 

3800 

100% 

100% 

APPENDIX  D 


I 


r 


FREQUENCIES  OF  RESPONSES  TO 
QUESTIONS  8,  14,  15,  16,  17,  19,  AND  20 


[Any  difference  from  100%  in  the  total  of  the  Percent  column  is  due  to  rounding.] 


I 


I 
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Frequency  of  Responses  to  Question  8: 
"1  usually  receive  Early  Bird  (EB):" 


Receive  EB 

Frequency 

Percent 

Cumulative 

Percent 

Every  working  day 

2875 

75.7% 

76.3% 

More  than  once  a 
week 

713 

18.8% 

95.2% 

Once  a  week 

99 

2.6% 

97.8% 

Twice  a  month 

31 

.8% 

98.6% 

Once  a  month 

16 

.4% 

99.1% 

Rarely 

35 

.9% 

100% 

No  response  to 
this  item 

31 

.8% 

nor  included 

Column  Total  & 
Percent 

3800 

100% 

100% 

Frequency  of  Responses  to  Question  14: 

'Using  the  method  in  Question  13, 1  believe  that  the  number  of 


1  Others 

Frequency 

Percent 

Cumulative 

Percent 

MO 

2499 

65.8% 

85.9% 

11-20 

307 

8.1% 

96.5% 

21-50 

65 

1.7% 

98.7% 

1  ^ 

37 

1% 

100%  1 

1  No  response  to 

1  this  item 

892 

23.5% 

not  included 

1  Column  Total  & 

1  Percent 

3800 

100% 

100% 

Frequency  of  Responses  to  Question  15: 
"Those  I  pass  EB  on  to  are  mostly:" 


Question  15 

Frequency 

Percent 

Cumulative 

Percent 

Policy  Makers 

221 

5.8% 

7.6% 

Managers 

519 

13.7% 

25.5% 

Action  Officers 

1469 

38.7% 

76% 

Scholars/Analysts 

285 

7.5% 

85.8% 

Clerical/Admini- 

strative 

130 

3.4% 

90.3% 

Technical  Staff 

149 

3.9% 

95.4% 

Non-Government 

Management 

19 

.5% 

96% 

Other 

115 

3% 

100% 

No  response  to 
this  item 

893 

23.5% 

not  included 

Column  Total  & 
Percent 

3800 

100% 

100% 
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Frequency  of  Responses  to  Question  16: 


"Most  of  the  people  I  pass  It  on  to  hold  the  rank/grade  of:" 


Rank/Grade 

Frequency 

Percent 

Cumulative 

Percent 

E1-E6 

100 

2.6% 

3.5% 

E7.E9 

81 

2.1% 

6.3% 

W1-W4 

2 

.1% 

6.4% 

01-03 

190 

5% 

13% 

04-06 

1345 

35.4% 

59.7% 

07  &  above 

54 

1.4% 

61.6% 

GS1-GS7 

34 

.9% 

62.8% 

GS8-GS12 

214 

5.6% 

70.2% 

GS/GM13- 

GS/GM15 

580 

15.3% 

90.3% 

SES  GS16-GS18 

53 

1.4% 

92.2% 

Jr  Professional 

18 

.5% 

92.8% 

Mid-ievel 

Professional 

90 

2.4% 

95.9% 

Sr  Professional 

92 

2.4% 

99.1% 

Cterk/Support 

2 

.1% 

99.2% 

Technician 

2 

.1% 

99.3% 

Other 

21 

.6% 

100% 

No  response  to 
this  item 

922 

24.3% 

not  included 

Column  Total  & 
Percent 

3800 

100% 

100% 

Frequency  of  Responses  to  Question  17: 


"The  number  of  people  working 

in  my  office  is  approximately:" 

Number  others 

Frequency 

Percent 

Cumulative 

Percent 

less  than  10 

1812 

47.7% 

47.9% 

10-15 

830 

21.8% 

69.9% 

16-20 

334 

8.8% 

78.7% 

21-25 

181 

4.8% 

83.5% 

26-30 

124 

3.3% 

86.8% 

31-35 

83 

2.2% 

89% 

35+ 

417 

11% 

100% 

No  response  to 
this  item 

19 

.5% 

not  included 

Column  Total  & 
Percent 

3800 

100% 

100% 

Frequency  of  Responses  to  Question  19: 

"Of  the  EB  issues  received  throughout  a  month,  I 
usuaiiy  read  in  some  detail:" _ 


1  Number  read 

Frequency 

Percent 

Cumulative  | 

Percent  | 

1-5 

721 

19% 

19.1%  1 

6-10 

746 

19.6% 

39%  1 

11-15 

739 

19.4% 

58.6%  1 

16-20 

1560 

41.1% 

100%  1 

No  response  to 
this  item 

34 

.9% 

not  included  I 

Column  Total  & 
Percent 

3800 

100% 

100% 
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Frequency  of  Responses  to  Question  20: 

"The  total  number  of  minutes  I  usually  spend  reading  each  issue  of  EB  is:" 


Time  spent 

Frequency 

Percent 

Cumulative 

Percent 

less  than  15 
minutes 

850 

22.4% 

22.5% 

15-30 

2305 

60.7% 

83.4% 

31-45 

513 

13.5% 

97% 

46-60 

92 

2.4% 

99.4% 

More  than  60 

22 

.6% 

100% 

No  response  to 
this  item 

18 

.5% 

not  included 

Column  Total  & 
Percent 

3800 

100% 

100% 

APPENDIX  E 

FREQUENCIES  OF  RESP 
QUESTIONS  18,  22A-22C,  23A-23, 


[Any  difference  from  100%  in  the 


0^  tKik  Dd 


E- 


Frequency  of  Responses  to  Question  18: 
"Of  the  articles  in  EB,  I  usually  read:" 


Articles  Read 

Frequency 

Percent 

Cumulative 

Percent 

All 

782 

20.6% 

20.6% 

Over  half 

1459 

38.4% 

59.1% 

About  half 

753 

19.8% 

79% 

Less  than  half 

599 

15.8% 

94.8% 

1-2 

140 

3.7% 

98.5% 

Headlines  only 

49 

1.3% 

99.8% 

None 

8 

.2% 

100% 

No  response  to 
this  item 

10 

.3% 

not  included 

Column  Total  & 
Percent 

3800 

100% 

100% 

Frequency  of  Responses  to  Question  22A: 
"EB  presents  articles  relevant  to  my  duties:" 


Q22A 

Frequency 

Percent 

Cumulative 

Percent 

Strongly  Agree 

1185 

31.2% 

31.4% 

Agree 

1816 

47.8% 

79.5% 

Neither  Agree  nor 
Disagree 

593 

15.6% 

95.2% 

_ 

Disagree 

163 

4.3% 

99.5% 

Strongly  Disagree 

18 

.5% 

100% 

No  response  to 
this  item 

25 

.7% 

not  included 

Column  Total  & 
Percent 

3800 

100% 

100% 
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Frequency  of  Responses  to  Question  22B: 
"EB  increases  my  knowiedge  of  DoD  poiicies, 
programs  and  activities  ” 


Q22B 

Frequency 

Percent 

Cumulative 

Percent 

Strongly  Agree 

1497 

39.4% 

40.1% 

Agree 

1821 

47.9% 

88.9% 

Neither  Agree  nor 
Disagree 

326 

8.6% 

97.6% 

Disagree 

74 

1.9% 

99.6% 

Strongly  Disagree 

14 

.4% 

100% 

No  response  to 
this  item 

68 

1.8% 

not  included 

Column  Total  & 
Percent 

3800 

100% 

100% 

Frequency  of  Responses  Question  22C: 


"EB  gives  me  information  on  the  results  of  DoD  policy  decisions  *’ 


Q22C 

Frequency 

Percent 

Cumulative 

Percent 

Strongly  Agree 

1066 

28.1% 

28.6% 

Agree 

1964 

51.7% 

81.2% 

Neither  Agree  nor 
Disagree 

568 

14.9% 

96.4% 

Disagree 

118 

3.1% 

99.6% 

Strongly  Disagree 

16 

.4% 

100% 

No  response  to 
this  item 

68 

1.8% 

not  included 

Column  Total  & 
Percent 

3800 

100% 

100% 
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Frequency  of  Responses  to  Question  23A; 
"EB  is  a  vaiuabie  source  of  information  on 
Internationai  Security  issues" 


Q23A 

Frequency 

Percent 

Cumulative 

Percent 

Strongly  Agree 

971 

25.6% 

25.8% 

Agree 

2059 

54.2% 

80.5% 

Neither  Agree  nor 
Disagree 

626 

16.5% 

97.2% 

Disagree 

97 

2.6% 

99.7% 

Strongly  Disagree 

10 

.3% 

100% 

No  response  to 
this  item 

37 

1% 

not  included 

Column  Total  & 
Percent 

3800 

100% 

100% 

Frequency  of  Responses  to  Question  23B: 


"EB  is  a  vaiuabie  source  of  information  on  Military  balance^hreat" 


Q23B 

Frequency 

Percent 

Cumulative 

Percent 

Strongly  Agree 

827 

21.8% 

22% 

Agree 

2067 

54.4% 

77% 

Neither  Agree  nor 
Disagree 

732 

19.3% 

96.4% 

Disagree 

122 

3.2% 

99.7% 

Strongly  Disagree 

12 

.3% 

100% 

No  response  to 
this  item 

40 

1.1% 

not  included 

Column  Total  & 
Percent 

3800 

100% 

100% 

1 
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Frequency  of  Responses  to  Question  23C: 
"EB  is  a  vaiuabie  source  of  information 
on  OoD  manpower  &  personnei” 


Q23C 

Frequency 

Percent 

Cumulative 

Percent 

Strongly  Agree 

655 

17.2% 

17.5% 

Agree 

2116 

55.7% 

73.8% 

Neither  Agree  nor 
Disagree 

839 

22.1% 

96.2% 

Disagree 

133 

3.5% 

99.7% 

Strongiy  Disagree 

10 

.3% 

100% 

No  response  to 
this  item 

47 

1.2% 

not  included 

Column  Total  & 
Percent 

3800 

100% 

100% 

Frequency  of  Responses  to  Question  23D: 

"EB  is  a  vaiuabie  source  of  information  on  Operations  &  Readiness" 


Q230 

Frequency 

Percent 

Cumulative 

Percent 

Strongly  Agree 

555 

14.6% 

14.8% 

Agree 

1884 

49.6% 

65.1% 

Neither  Agree  nor 
Disagree 

1066 

28.1% 

93.5% 

Disagree 

230 

6.1% 

99.7% 

Strongly  Disagree 

13 

.3% 

100% 

No  response  to 
this  item 

52 

1.4% 

not  included 

ij 


Column  Total  & 
Percent 


3800 


100% 


100% 


Frequency  of  Responses  to  Question  23E: 

EB  Is  a  valuable  source  of  information  on  Research  &  Development" 


Q23E 

Frequency 

Percent 

Cumulative 

Percent 

Strongly  Agree 

483 

12.7% 

12.9% 

Agree 

1976 

52% 

65.6% 

Neither  Agree  nor 
Disagree 

1084 

28.5% 

9^.5% 

Disagree 

194 

5.1% 

99.7% 

Strongly  Disagree 

12 

.3% 

100% 

No  response  to 
this  item 

51 

1.3% 

not  included 

Column  Total  & 
Percent 

3800 

100% 

100% 

F 

”1 

■requency  of  Responses  to  Question  23F 
SB  is  a  valuable  source  of  information  oi 
Guard  and  Reserve  affairs" 

• 

• 

1 

Q23F 

Frequency 

Percent 

Cumulative 

Percent 

Strongly  Agree 

261 

6.9% 

7% 

Agree 

1328 

34.9% 

42.5% 

Neither  Agree  nor 
Disagree 

1761 

46.3% 

89.6% 

Disagree 

359 

9.4% 

99.2% 

Strongly  Disagree 

30 

.8% 

100% 

No  response  to 
this  item 

61 

1.6% 

not  included 

Column  Total  & 
Percent 

3800 

100% 

100% 
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Frequency  of  Responses  to  Question  23G: 

"EB  is  a  vaiuabie  source  of  information  on  DoD  and  the  environment" 


Q23G 

Frequency 

Percent 

Cumulative 

Percent 

Strongly  Agree 

539 

14.2% 

14.4% 

Agree 

1898 

49.9% 

65.1% 

Neither  Agree  nor 
Disagree 

1075 

28.3% 

93.8% 

Disagree 

215 

5.7% 

99.6% 

Strongly  Disagree 

16 

.4% 

100% 

No  response  to 
this  item 

57 

1.5% 

not  included 

Column  Total  & 
Percent 

3800 

100% 

100% 

Frequency  of  Responses  to  Question  23H: 
"EB  is  a  valuable  source  of  information  on 
_ organization  and  budget" 


Q23H 

Frequency 

Percent 

Cumulative 

Percent 

Strongly  Agree 

814 

21.4% 

21.7% 

Agree 

2223 

58.5% 

81% 

Neither  Agree  nor 
Disagree 

602 

15.8% 

97% 

Disagree 

103 

2.7% 

99.8% 

Strongly  Disagree 

9 

.2% 

100% 

No  response  to 
this  item 

49 

1.3% 

not  included 

Column  Total  & 
Percent 

3800 

100% 

100% 

Frequency  of  Responses  to  Question  23i; 

"EB  is  a  valuable  source  of  information  on  DoD  special  operations'* 


Q23I 

Frequency 

Percent 

Cumulative 

Percent 

Strongly  Agree 

341 

9% 

9.1% 

Agree 

1247 

32.8% 

42.5% 

Neither  Agree  nor 
Disagree 

1529 

40.2% 

83.4% 

Disagree 

540 

14.2% 

97.8% 

Strongly  Disagree 

81 

2.1% 

100% 

No  response  to 
this  item 

62 

1.6% 

not  included 

Column  Total  & 
Percent 

3800 

100% 

100% 

Frequency  of  Responses  to  Question  23J: 

"EB  Is  a  valuable  source  of  information  on  Other  DoD  issues” 


Q23J 

Frequency 

Percent 

Cumulative 

Percent 

Strongly  Agree 

237 

6.2% 

17.6% 

Agree 

516 

13.6% 

55.9% 

Neither  Agree  nor 
Disagree 

550 

14.5% 

96.7% 

Disagree 

35 

.9% 

99.3% 

Strongly  Disagree 

9 

.2% 

100% 

No  response  to 
this  item 

2453 

64.6% 

not  included 

Column  Total  & 
Percent 

3800 

100% 

100% 
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Frequency  of  Responses  to  Question  25A: 
"EB  helps  me  set  my  dally  agenda  ** 


Q25A 

Frequency 

Percent 

Cumulative 

Percent 

Strongly  Agree 

102 

2.7% 

2.7% 

Agree 

229 

6% 

8.9% 

Neither  Agree  nor 
Disagree 

1418 

37.3% 

47.1% 

Disagree 

1481 

39% 

87% 

Strongly  Disagree 

482 

12.7% 

100% 

No  response  to 
this  item 

88 

2.3% 

not  included 

Column  Total  & 
Percent 

3800 

100% 

100% 

Frequency  of  Responses  to  Question  25B: 


”EB  helps  me  gather  the  Information  I  need  to  do  my  |ob  well  ’’ 


Q25B 

Frequency 

Percent 

Cumuiativo 

Percent 

Strongly  Agree 

478 

12.6% 

12.8% 

Agree 

1432 

37.7% 

51.2%  1 

Neither  Agree  nor 
Disagree 

1094 

28.8% 

80.4% 

Disagree 

603 

15.9% 

96.6% 

Strongly  Disagree 

127 

3.3% 

100% 

No  response  to 
this  item 

66 

1.7% 

not  included 

Column  Total  & 
Percent 

3800 

100% 

100% 

_  1 
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Frequency  of  Responses  to  Question  25C: 

"EB  helps  me  understand  the  effect  on  my  decisions/actions 

on  public  opinion  “ 


Q25C 

Frequency 

Percent 

Cumulative 

Percent 

Strongly  Agree 

442 

11.9% 

11.9% 

Agree 

1386 

36.5% 

49.3% 

Neither  Agree  nor 
Disagree 

1286 

33.8% 

84% 

Disagree 

476 

12.5% 

96.8% 

Strongly  Disagree 

118 

3.1% 

100% 

No  response  to 
this  item 

92 

2.4% 

not  included 

Column  Total  & 
Percent 

3800 

100% 

100% 

Frequency  of  Responses  to  Question  26: 
''Overall,  I  find  EB  a  useful  publication  " 


1  Q26 

Frequency 

Percent 

Cumulative 

Percent 

Strongly  Agree 

1948 

51.3% 

53.2% 

Agree 

1518 

39.9% 

94.6% 

Neither  Agree  nor 
Disagree 

157 

4.1% 

98.9% 

Disagree 

32 

.8% 

99.8% 

Strongly  Disagree 

7 

.2% 

100% 

No  response  to 
this  item 

138 

3.6% 

not  included 

Column  Total  & 
Percent 

3800 

100% 

100%  I 

E- 


APPENDIX  F 


FREQUENCIES  OF  RESPONSES  TO 
QUESTIONS  21A-2IE  AND  24A-24H 


[Any  difference  from  100%  in  the  total  of  the  Percent  column  is  due  to  rounding.] 


Frequency  of  Responses  to  Question  21  A: 
'The  articles  in  EB  represent  the  most  current  news 
available  on  DoO  topics  ” 


Q21A 

Frequency 

Percent 

Cumulative 

Percent 

Strongly  Agree 

1744 

46.2% 

46.2% 

Agree 

1815 

48.1% 

94.4% 

Neither  Agree  nor 
Disagree 

162 

4.3% 

98.7% 

Disagree 

45 

1.2% 

99.9% 

Strongly  Disagree 

5 

.1% 

100% 

No  response  to 
this  item 

29 

.8% 

not  included 

Column  Total  & 
Percent 

3800 

100% 

100% 

Frequency  of  Responses  to  Question  21 B: 
"EB  is  a  valuable  news  source  on  DoD  issues  ” 


Q21B 

Frequency 

Percent 

Cumulative 

Percent 

Strongly  Agree 

2202 

57.9% 

59% 

Agree 

1366 

35.9% 

95.6% 

Neither  Agree  nor 
Disagree 

132 

3.5% 

99.1% 

Disagree 

23 

.6% 

99.7% 

Strongly  Disagree 

10 

.3% 

100% 

1  No  response  to 
this  item 

67 

1.8% 

1 

not  included 

Column  Total  & 
Percent 

3800 

100% 

100% 

F-3 


Frequency  of  Responses  to  Question  21 C: 


”EB  presents  a  variety  of  poiitical  opinions  on  most  DoD  issues  ” 


Q21C 

Frequency 

Percent 

Cumulative 

Percent 

Strongly  Agree 

875 

23% 

23.5% 

Agree 

1913 

50.3% 

75% 

Neither  Agree  nor 
Disagree 

736 

19.4% 

94.8% 

Disagree 

177 

4.7% 

99.6% 

Strongly  Disagree 

16 

.4% 

100% 

No  response  to 
this  item 

83 

2.2% 

not  included 

Column  Total  & 
Percent 

3800 

100% 

100% 

Frequency  of  Responses  to  Question  21 D: 
"Overali,  the  sources  used  in  EB  represents  a  wide  variety 
from  across  the  country  *' 


Q21D 

Frequency 

Percent 

Cumulative 

Percent 

Strongly  Agree 

1071 

28.2% 

28.8% 

Agree 

1947 

51.2% 

81.1% 

Neither  Agree  nor 
Disagree 

496 

13.1% 

94.4% 

Disagree 

199 

5.2% 

99.7% 

Strongly  Disagree 

10 

.3% 

100% 

No  response  to 
this  item 

77 

2% 

not  included 

Column  Total  & 
Percent 

3800 

100% 

100%  I 

F- 


Frequency  of  Responses  to  Question  21 E: 

’The  wide  range  of  DoD  topics  presented  in  EB  heips  me  in  my  job  " 


Q21E 

Frequency 

Percent 

Cumulative 

Percent 

Strongly  Agree 

1219 

32.1% 

32.8% 

Agree 

1678 

44.2% 

77.9% 

Neither  Agree  nor 
Disagree 

676 

17.8% 

96.1% 

Disagree 

114 

3% 

99.1% 

Strongly  Disagree 

32 

.8% 

100% 

No  response  to 
this  item 

81 

2.1% 

not  included 

Column  Total  & 
Percent 

3800 

100% 

100% 

Frequency  of  Responses  to  Question  24A: 

"EB  Is  an  effective  aid  In  making  decisions  regarding  R&P" 


Q24A 

Frequency 

Percent 

Cumulative 

Percent 

Strongly  Agree 

150 

3.9% 

4.1% 

Agree 

695 

18.3% 

23.4% 

Neither  Agree  nor 
Disagree 

2162 

56.9% 

83.1% 

Disagree 

540 

14.2% 

98.1% 

Strongly  Disagree 

70 

1.8% 

100% 

No  response  to 
this  item 

183 

4.8% 

not  included 

Column  Total  & 
Percent 


3800 


100% 


100% 


Frequency  of  Responses  to  Question  24B: 


"EB  is  an  effective  aid  in  making  decisions  regarding  Operations” 


Q24B 

Frequency 

Percent 

Cumulative 

Percent 

Strongly  Agree 

209 

5.5% 

5.8% 

Agree 

892 

23.5% 

30.4% 

Neither  Agree  nor 
Disagree 

1910 

50.3% 

83.2% 

Disagree 

531 

14% 

97.8% 

Strongiy  Disagree 

78 

2.1% 

100% 

No  response  to 
this  item 

180 

4.7% 

not  included 

Column  Total  & 
Percent 

3800 

100% 

100% 

Frequency  of  Responses  to  Question  24C:  # 


"EB  is  an  effective  aid  in  making  decisions  regarding  Logistics" 


Q24C 

Frequency 

Percent 

Cumulative 

Percent 

Strongly  Agree 

153 

4% 

4.2% 

Agree 

871 

22.9% 

28.3% 

Neither  Agree  nor 
Disagree 

2015 

53% 

84.1% 

Disagree 

510 

13.4% 

98.2% 

Strongly  Disagree 

66 

1.7% 

100% 

No  response  to 
this  item 

185 

4.9% 

not  included 

Column  Total  & 
Percent 

3800 

100% 

100% 

F-6 


Frequency  of  Responses  to  Question  24D: 

"EB  Is  an  effective  aid  In  making  decisions  regarding  Budgef 


Q24D 

Frequency 

Percent 

Cumulative 

Percent 

Strongly  Agree 

270 

7.1% 

7.5% 

Agree 

1084 

28.5% 

37.4% 

Neither  Agree  nor 
Disagree 

1741 

45.8% 

85.5% 

Disagree 

458 

12.1% 

98.2% 

Strongly  Disagree 

66 

1.8% 

100% 

No  response  to 
this  item 

181 

4.8% 

not  included 

Column  Total  & 
Percent 

3800 

100% 

100% 

Frequency  of  Responses  to  Question  24E: 
"EB  is  an  effective  aid  in  making  decisions 
regarding  Procurement/acquisition" 


Q24E 

Frequency 

Percent 

Cumulative 

Percent 

Strongly  Agree 

213 

5.6% 

5.9% 

Agree 

970 

25.5% 

32.7% 

Neither  Agree  nor 
Disagree 

1904 

50.1% 

85.3%  1 

Disagree 

463 

12.2% 

98.1% 

Strongly  Disagree 

67 

1.8% 

100% 

No  response  to 
this  item 

183 

4.8% 

not  included 

Column  Totai  & 
Percent 

3800 

100% 

100% 

Frequency  of  Responses  to  Question  24F: 
"EB  is  an  effective  aid  in  making  decisions 
regarding  Pubiic  Affairs/Legisiative” 


1  Q24F 

Frequency 

Percent 

Cumulative 

Percent 

Strongly  Agree 

593 

15.6% 

16.3% 

Agree 

1255 

33% 

50.9% 

Neither  Agree  nor 
Disagree 

1404 

36.9% 

89.5% 

Disagree 

339 

8.9% 

98.8% 

Strongly  Disagree 

43 

1.1% 

100% 

No  response  to 
this  item 

166 

4.4% 

not  included 

Column  Total  & 
Percent 

3800 

100% 

100% 

Frequency  of  Responses  to  Question  24G:  • 


"EB  is  an  effective  aid  in  making  decisions  regarding  intelligence" 


Q24G 

Frequency 

Percent 

Cumulative 

Percent 

Strongly  Agree 

187 

4.9% 

5.3% 

Agree 

694 

18.3% 

24.7% 

Neither  Agree  nor 
Disagree 

1928 

50.7% 

78.9% 

Disagree 

631 

16.6% 

96.6% 

Strongly  Disagree 

121 

3.2% 

100% 

No  response  to 
this  item 

239 

6.3% 

not  included  j 

Column  Total  & 
Percent 

3800 

100% 

100% 

Frequency  of  Responses  to  Question  24H: 
"EB  is  an  effective  aid  in  making  decisions 
regarding  Other  OoD  issues" 


Q24H 

Frequency 

Percent 

Cumulative 

Percent 

Strongly  Agree 

103 

2.7% 

8.9% 

Agree 

191 

5% 

25.4% 

Neither  Agree  nor 
Disagree 

709 

18.7% 

86.8% 

Disagree 

132 

3.5% 

98.2% 

Strongiy  Disagree 

21 

.6% 

100% 

No  response  to 
this  item 

2644 

69.6% 

not  included 

Column  Total  & 
Percent 

3800 

100% 

100% 

F-9 


